00000001:02000400:3.0F:1784755922.828220:0:2964:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing set_hostid 00000001:02000400:3.0:1784755930.847513:0:3166:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1784755931.885007:0:3228:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1315 MB/s 00000001:01000000:0.0:1784755932.134958:0:3228:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1711 MB/s 00000001:01000000:0.0:1784755932.384513:0:3228:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 10291 MB/s 00000020:02000000:0.0:1784755932.665959:0:3259:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_183_g9c9e10a 00000400:02000000:1.0F:1784755933.022728:0:3274:0:(api-ni.c:2766:lnet_startup_lndni()) Added LNI 192.168.202.141@tcp [8/256/0/180] 00008000:02000000:0.0:1784755935.459679:0:3423:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1784755976.897554:0:5222:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1784755984.648072:0:5755:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1784755984.648079:0:5755:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1784755984.648218:0:5755:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000357b77f2 00000080:02000400:3.0:1784755984.648229:0:5755:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1784755984.658768:0:5755:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1784755984.658840:0:5755:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1784755984.658880:0:5755:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000a22dd39a) 00000020:00000080:3.0:1784755984.658905:0:5755:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1784755984.696375:0:5755:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1784755984.698257:0:5755:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0F:1784755984.731934:0:5755:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1784755984.731991:0:5755:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1784755984.732086:0:5755:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1784755984.732140:0:5755:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1784755984.732167:0:5755:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1784755984.732776:0:5755:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1784755984.732859:0:5755:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784755984.732871:0:5755:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc0f560bd53f8d1b 00000020:01000004:2.0:1784755984.732879:0:5755:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1784755984.732885:0:5755:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1784755984.732890:0:5755:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000357b77f2 from MGS 00000020:01000004:2.0:1784755984.732895:0:5755:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1784755984.732918:0:5755:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000a260aa04) 00000020:00000080:2.0:1784755984.732931:0:5755:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1784755984.733140:0:5755:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000357b77f2 from MGS, refs=2 00080000:01000000:2.0:1784755984.733145:0:5755:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1784755984.733151:0:5755:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc0f560bd53f8d29 00000100:00100000:2.0:1784755984.733259:0:5755:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1784755984.733387:0:5755:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1784755984.733393:0:5755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1784755984.734337:0:5755:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1784755984.734347:0:5755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1784755984.737305:0:5755:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784755984.737955:0:5755:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1784755984.737962:0:5755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1784755984.738907:0:5755:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1784755984.738916:0:5755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1784755984.739323:0:5755:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1784755984.739330:0:5755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1784755984.740714:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784755984.740719:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784755984.740720:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784755984.741118:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784755984.741120:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784755984.741121:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784755984.741994:0:5755:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1784755984.745872:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1784755984.991473:0:5755:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3447 MB/s 00000001:01000000:3.0:1784755985.241881:0:5755:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4551 MB/s 00000001:01000000:1.0:1784755985.493242:0:5755:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 601 MB/s 00000001:01000000:0.0:1784755985.746156:0:5755:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 628 MB/s 00080000:10000000:2.0:1784755985.767123:0:5755:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:0.0:1784755985.787412:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1784755985.813136:0:5755:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1784755985.813153:0:5755:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1784755985.813156:0:5755:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1784755985.827409:0:5765:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1784755985.827907:0:5755:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1784755985.827961:0:5755:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1784755985.828199:0:5755:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1784755985.828229:0:5755:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1784755985.828589:0:5755:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784755985.828753:0:5755:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1784755985.828759:0:5755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1784755985.834435:0:5755:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1784755985.834468:0:5755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1784755985.848229:0:5755:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1784755985.848256:0:5755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1784755985.849562:0:5755:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1784755985.849594:0:5755:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.141@tcp' 00000020:01000004:2.0:1784755985.849596:0:5755:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000100:00080000:0.0:1784755985.850012:0:5770:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:2.0:1784755985.850089:0:5755:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.141@tcp (typ=mgc) 00000020:00000080:2.0:1784755985.850100:0:5755:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.141@tcp (00000000b8fe7d2e) 00000020:00000080:2.0:1784755985.850117:0:5755:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1784755985.850199:0:5755:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004c3b041d@MGC192.168.202.141@tcp: add connection 192.168.202.141@tcp at head 00010000:00010000:2.0:1784755985.850385:0:5755:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.141@tcp-0 is initialized 00000040:01000000:2.0:1784755985.850392:0:5755:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 1 is initialized 10000000:01000000:3.0:1784755985.856727:0:5772:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1784755985.856866:0:5755:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.141@tcp (uuid 3a5739ad-a70a-4582-8756-59cdd498af45) 00000020:00000080:0.0:1784755985.856889:0:5755:0:(genops.c:1406:class_connect()) connect: client 3a5739ad-a70a-4582-8756-59cdd498af45, cookie 0xc0f560bd53f8d37 00000100:00080000:0.0:1784755985.856901:0:5755:0:(import.c:510:import_select_connection()) MGC192.168.202.141@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784755985.856906:0:5755:0:(import.c:624:import_select_connection()) MGC192.168.202.141@tcp: import 000000004c3b041d using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1784755985.856957:0:5755:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000ff212f1 x1871452237201536/t0(0) o250->MGC192.168.202.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784755985.857069:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000ff212f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3a5739ad-a70a-4582-8756-59cdd498af45:3289:1871452237201536:0@lo:250: 00000100:00100000:3.0:1784755985.857142:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755985.857278:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237201536 00000100:00100000:1.0:1784755985.857285:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237201536 00000100:00100000:1.0:1784755985.857330:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784755985.857337:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000821e0830 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3289:x1871452237201536:12345-0@lo:250: 00010000:00080000:1.0:1784755985.857359:0:5768:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 3a5739ad-a70a-4582-8756-59cdd498af45@0@lo t0 exp 0000000000000000 cur 103 last 0 00000020:00000080:1.0:1784755985.857381:0:5768:0:(genops.c:1406:class_connect()) connect: client 3a5739ad-a70a-4582-8756-59cdd498af45, cookie 0xc0f560bd53f8d3e 00000100:00080000:1.0:1784755985.857545:0:5768:0:(import.c:65:import_set_state_nolock()) 00000000d114522f : changing import state from RECOVER to FULL 00000100:00080000:0.0:1784755985.860801:0:5755:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 3a5739ad-a70a-4582-8756-59cdd498af45->MGS 00000020:01000004:0.0:1784755985.860832:0:5755:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1784755985.860839:0:5755:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1784755985.860864:0:5755:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000ebd63b4e) 00000020:00000080:0.0:1784755985.860883:0:5755:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1784755985.879202:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000821e0830 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+5:3289:x1871452237201536:12345-0@lo:250: Request processed in 21845us (22041us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755985.879220:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784755985.885375:0:3289:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.202.141@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1784755985.885393:0:3289:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.141@tcp: connect to target with instance 0 00000100:00080000:3.0:1784755985.885401:0:3289:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.141@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1784755985.885407:0:3289:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1784755985.885411:0:3289:0:(import.c:65:import_set_state_nolock()) 000000004c3b041d MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1784755985.885428:0:3289:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1784755985.885441:0:3289:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1784755985.885449:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000ff212f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3a5739ad-a70a-4582-8756-59cdd498af45:3289:1871452237201536:0@lo:250: 00000100:00100000:0.0:1784755985.909311:0:5755:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784755985.909512:0:5755:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1784755985.909518:0:5755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1784755985.913891:0:5755:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1784755985.916847:0:5755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1784755985.919397:0:5755:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1784755985.919715:0:5755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1784755985.923618:0:5755:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784755985.925987:0:5755:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1784755985.925999:0:5755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1784755985.929443:0:5755:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1784755985.929460:0:5755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1784755986.010839:0:5755:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784755986.011356:0:5755:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1784755986.011364:0:5755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1784755986.016014:0:5755:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1784755986.016032:0:5755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1784755986.017835:0:5755:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784755986.018347:0:5755:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1784755986.018355:0:5755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1784755986.020362:0:5755:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1784755986.020377:0:5755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1784755986.021677:0:5755:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784755986.022561:0:5755:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1784755986.022568:0:5755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1784755986.023998:0:5755:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1784755986.024009:0:5755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1784755986.025409:0:5755:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784755986.025866:0:5755:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1784755986.025873:0:5755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1784755986.026666:0:5755:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1784755986.026673:0:5755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1784755986.071534:0:5755:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784755986.071857:0:5755:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1784755986.071865:0:5755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1784755986.077600:0:5755:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1784755986.077617:0:5755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1784755986.079950:0:5755:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1784755986.079965:0:5755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1784755986.081562:0:5755:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1784755986.081585:0:5755:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1784755986.081590:0:5755:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.141@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1784755986.081765:0:5755:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 00000020:01000004:0.0:1784755986.081851:0:5755:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.141@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1784755986.081856:0:5755:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1784755986.081858:0:5755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784755986.081859:0:5755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784755986.081861:0:5755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784755986.081862:0:5755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784755986.081863:0:5755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784755986.081865:0:5755:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784755986.081866:0:5755:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784755986.081868:0:5755:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784755986.081869:0:5755:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784755986.081871:0:5755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784755986.081872:0:5755:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784755986.081875:0:5755:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1784755986.081877:0:5755:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784755986.081878:0:5755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784755986.081879:0:5755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784755986.081880:0:5755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784755986.081881:0:5755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784755986.081883:0:5755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784755986.081884:0:5755:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784755986.081884:0:5755:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784755986.081885:0:5755:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784755986.081886:0:5755:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784755986.081893:0:5755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784755986.081894:0:5755:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784755986.081922:0:5755:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1784755986.081939:0:5755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000723ee73c pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:5755:1871452237201664:0@lo:253: 00000100:00100000:0.0:1784755986.082013:0:5755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755986.082280:0:5755:0:(client.c:2702:ptlrpc_set_wait()) set 00000000abb33ad9 going to sleep for 11 seconds 00000100:00100000:3.0:1784755986.082631:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237201664 00000100:00100000:3.0:1784755986.082639:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237201664 00000100:00100000:3.0:1784755986.082785:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784755986.082794:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e1910307 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+5:5755:x1871452237201664:12345-0@lo:253: 20000000:01000000:3.0:1784755986.082841:0:5769:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1784755986.082844:0:5769:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1784755986.083542:0:5790:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1784755986.083594:0:5769:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1784755986.083969:0:5769:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784755986.086307:0:5791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1784755986.086763:0:5769:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1784755986.086768:0:5769:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1784755986.086833:0:5769:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1784755986.086836:0:5769:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1784755986.086855:0:5769:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1784755986.087403:0:5769:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784755986.087866:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1784755986.087882:0:5769:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1784755986.087928:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1784755986.087983:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1784755986.088015:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1784755986.088630:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1784755986.088641:0:5769:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1784755986.088754:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1784755986.088763:0:5769:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1784755986.088854:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1784755986.088862:0:5769:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1784755986.088889:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1784755986.088941:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1784755986.088973:0:5769:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1784755986.088978:0:5769:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1784755986.088989:0:5769:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784755986.089517:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1784755986.089528:0:5769:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1784755986.089561:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1784755986.089599:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1784755986.089648:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1784755986.089661:0:5769:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1784755986.089857:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1784755986.089865:0:5769:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1784755986.089916:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1784755986.089950:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1784755986.089978:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1784755986.089988:0:5769:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1784755986.090377:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1784755986.090389:0:5769:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1784755986.090846:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1784755986.090886:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1784755986.091343:0:5769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1784755986.091392:0:5769:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1784755986.091400:0:5769:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1784755986.091972:0:5792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1784755986.093020:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1784755986.093252:0:5769:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.141@tcp for mdt 20000000:01000000:1.0:1784755986.093255:0:5769:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.141@tcp (null) (null) (null) 00000040:00080000:1.0:1784755986.093297:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1784755986.093305:0:5769:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1784755986.093331:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1784755986.093338:0:5769:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.141@tcp (null) (null) 00000040:00080000:1.0:1784755986.093376:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1784755986.093385:0:5769:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1784755986.093465:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1784755986.093500:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1784755986.093565:0:5769:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1784755986.093580:0:5769:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1784755986.093583:0:5769:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1784755986.093606:0:5769:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1784755986.093609:0:5769:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1784755986.093650:0:5769:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1784755986.093652:0:5769:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1784755986.094525:0:5793:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1784755986.094870:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1784755986.094909:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1784755986.094963:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:2.0:1784755986.094978:0:5769:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1784755986.094980:0:5769:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1784755986.095641:0:5794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1784755986.095965:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1784755986.096012:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1784755986.096502:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1784755986.096520:0:5769:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784755986.096522:0:5769:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1784755986.096527:0:5769:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1784755986.096530:0:5769:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1784755986.096535:0:5769:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1784755986.096541:0:5769:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1784755986.097395:0:5795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1784755986.097678:0:5769:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1784755986.109905:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1784755986.109981:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1784755986.110322:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1784755986.110346:0:5769:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1784755986.110368:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f9462a15/0xc0f560bd53f8d4c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755986.110386:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f9462a15/0xc0f560bd53f8d4c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755986.110399:0:5769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f9462a15/0xc0f560bd53f8d4c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755986.110406:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f9462a15/0xc0f560bd53f8d4c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755986.110645:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f9462a15/0xc0f560bd53f8d4c lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755986.110653:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f9462a15/0xc0f560bd53f8d4c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755986.110659:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f9462a15 already unused, calling callback (00000000a63d5d09) 00010000:00010000:3.0:1784755986.110663:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f9462a15/0xc0f560bd53f8d4c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755986.110671:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f9462a15/0xc0f560bd53f8d4c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755986.110772:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f9462a15/0xc0f560bd53f8d4c lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755986.110781:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f9462a15/0xc0f560bd53f8d4c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755986.110860:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f9462a15/0xc0f560bd53f8d4c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784755986.110884:0:5769:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1784755986.383491:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e1910307 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+5:5755:x1871452237201664:12345-0@lo:253: Request processed in 300689us (301469us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755986.383508:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784755986.383755:0:5755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000723ee73c pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:5755:1871452237201664:0@lo:253: 10000000:01000000:0.0:1784755986.383774:0:5755:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1784755986.383777:0:5755:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784755986.383779:0:5755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784755986.383780:0:5755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784755986.383781:0:5755:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1784755986.383783:0:5755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784755986.383784:0:5755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784755986.383785:0:5755:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784755986.383786:0:5755:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784755986.383788:0:5755:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1784755986.383789:0:5755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784755986.383790:0:5755:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1784755986.383815:0:5755:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000357b77f2 from lustre-MDT0000 10000000:01000000:0.0:1784755986.383842:0:5755:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1784755986.383845:0:5755:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1784755986.383849:0:5755:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff891347b0b380 10000000:01000000:0.0:1784755986.383853:0:5755:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784755986.383862:0:5755:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff891347b0b380 from 1 10000000:01000000:0.0:1784755986.383865:0:5755:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784755986.383903:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 00000000491b9ab9/0xc0f560bd53f8d53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755986.383928:0:5755:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 00000000491b9ab9/0xc0f560bd53f8d53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755986.383937:0:5755:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 00000000491b9ab9/0xc0f560bd53f8d53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755986.383955:0:5755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000723ee73c pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:5755:1871452237201792:0@lo:101: 00000100:00100000:0.0:1784755986.383993:0:5755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755986.384087:0:5755:0:(client.c:2702:ptlrpc_set_wait()) set 00000000723611aa going to sleep for 11 seconds 00000100:00100000:1.0:1784755986.384216:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237201792 00000100:00100000:1.0:1784755986.384224:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237201792 00000100:00100000:1.0:1784755986.384301:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784755986.384309:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e8864dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+5:5755:x1871452237201792:12345-0@lo:101: 00010000:00010000:1.0:1784755986.384323:0:5767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784755986.384337:0:5767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000094a09e1a/0xc0f560bd53f8d5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0f560bd53f8d53 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755986.384360:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000094a09e1a/0xc0f560bd53f8d5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0f560bd53f8d53 expref: 6 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755986.384370:0:5767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000094a09e1a/0xc0f560bd53f8d5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8d53 expref: 6 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755986.384379:0:5767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000094a09e1a, rc 0) 00000100:00100000:1.0:1784755986.384438:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e8864dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+6:5755:x1871452237201792:12345-0@lo:101: Request processed in 130us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755986.384443:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784755986.384510:0:5755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000723ee73c pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:5755:1871452237201792:0@lo:101: 00010000:00010000:3.0:1784755986.384524:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 00000000491b9ab9/0xc0f560bd53f8d53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8d5a expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755986.384550:0:5755:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 00000000491b9ab9/0xc0f560bd53f8d53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0f560bd53f8d5a expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755986.384627:0:5755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d8d54385 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:5755:1871452237201920:0@lo:501: 00000100:00100000:3.0:1784755986.384652:0:5755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755986.384869:0:5755:0:(client.c:2702:ptlrpc_set_wait()) set 000000005cee311f going to sleep for 11 seconds 00000100:00100000:0.0:1784755986.384959:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237201920 00000100:00100000:0.0:1784755986.384964:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237201920 00000100:00100000:0.0:1784755986.384985:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784755986.384991:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008cffdebf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+6:5755:x1871452237201920:12345-0@lo:501: 00000100:00100000:0.0:1784755986.385292:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008cffdebf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+6:5755:x1871452237201920:12345-0@lo:501: Request processed in 300us (638us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784755986.385301:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784755986.385399:0:5755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d8d54385 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:5755:1871452237201920:0@lo:501: 10000000:01000000:3.0:1784755986.385492:0:5755:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1784755986.385655:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 00000000491b9ab9/0xc0f560bd53f8d53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8d5a expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755986.385666:0:5755:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: 00000000491b9ab9/0xc0f560bd53f8d53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8d5a expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784755986.385676:0:5755:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8913516af000 10000000:01000000:3.0:1784755986.385681:0:5755:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784755986.385685:0:5755:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8913516af000 10000000:01000000:3.0:1784755986.385688:0:5755:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1784755986.385690:0:5755:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff8913516af000 from 1 10000000:01000000:3.0:1784755986.385693:0:5755:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1784755986.385717:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 00000000f9462a15/0xc0f560bd53f8d61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755986.385725:0:5755:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 00000000f9462a15/0xc0f560bd53f8d61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755986.385733:0:5755:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 00000000f9462a15/0xc0f560bd53f8d61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755986.385759:0:5755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d8d54385 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:5755:1871452237202048:0@lo:101: 00000100:00100000:3.0:1784755986.385788:0:5755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755986.385916:0:5755:0:(client.c:2702:ptlrpc_set_wait()) set 000000005cee311f going to sleep for 11 seconds 00000100:00100000:2.0:1784755986.385976:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237202048 00000100:00100000:2.0:1784755986.385981:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237202048 00000100:00100000:2.0:1784755986.386018:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784755986.386025:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000666593e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+6:5755:x1871452237202048:12345-0@lo:101: 00010000:00010000:2.0:1784755986.386033:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784755986.386047:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000345230b/0xc0f560bd53f8d68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0f560bd53f8d61 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755986.386064:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000345230b/0xc0f560bd53f8d68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0f560bd53f8d61 expref: 7 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755986.386073:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000345230b/0xc0f560bd53f8d68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8d61 expref: 7 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755986.386082:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000345230b, rc 0) 00000100:00100000:2.0:1784755986.386196:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000666593e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+7:5755:x1871452237202048:12345-0@lo:101: Request processed in 172us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755986.386202:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784755986.386349:0:5755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d8d54385 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:5755:1871452237202048:0@lo:101: 00010000:00010000:3.0:1784755986.386361:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 00000000f9462a15/0xc0f560bd53f8d61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8d68 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755986.386368:0:5755:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 00000000f9462a15/0xc0f560bd53f8d61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0f560bd53f8d68 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784755986.386379:0:5755:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1784755986.386454:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 00000000f9462a15/0xc0f560bd53f8d61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8d68 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755986.386461:0:5755:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: 00000000f9462a15/0xc0f560bd53f8d61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8d68 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784755986.386467:0:5755:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1784755986.386470:0:5755:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784755986.386475:0:5755:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8913516af000 10000000:01000000:3.0:1784755986.386476:0:5755:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1784755986.386479:0:5755:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1784755986.386481:0:5755:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1784755986.386493:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 00000000edfe06f0/0xc0f560bd53f8d6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755986.386499:0:5755:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 00000000edfe06f0/0xc0f560bd53f8d6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755986.386516:0:5755:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 00000000edfe06f0/0xc0f560bd53f8d6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755986.386527:0:5755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d8d54385 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:5755:1871452237202176:0@lo:101: 00000100:00100000:3.0:1784755986.386662:0:5755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755986.386689:0:5755:0:(client.c:2702:ptlrpc_set_wait()) set 000000005cee311f going to sleep for 11 seconds 00000100:00100000:0.0:1784755986.386739:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237202176 00000100:00100000:0.0:1784755986.386744:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237202176 00000100:00100000:0.0:1784755986.386777:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784755986.386783:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b098e91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+7:5755:x1871452237202176:12345-0@lo:101: 00010000:00010000:0.0:1784755986.386790:0:5768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784755986.386798:0:5768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000469bda4d/0xc0f560bd53f8d76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0f560bd53f8d6f expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755986.386810:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000469bda4d/0xc0f560bd53f8d76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0f560bd53f8d6f expref: 8 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755986.386817:0:5768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000469bda4d/0xc0f560bd53f8d76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8d6f expref: 8 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755986.386829:0:5768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000469bda4d, rc 0) 00000100:00100000:0.0:1784755986.386858:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b098e91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+8:5755:x1871452237202176:12345-0@lo:101: Request processed in 75us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755986.386864:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784755986.386942:0:5755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d8d54385 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:5755:1871452237202176:0@lo:101: 00010000:00010000:3.0:1784755986.386951:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 00000000edfe06f0/0xc0f560bd53f8d6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8d76 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755986.386958:0:5755:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 00000000edfe06f0/0xc0f560bd53f8d6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0f560bd53f8d76 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755986.386998:0:5755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d8d54385 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:5755:1871452237202304:0@lo:501: 00000100:00100000:3.0:1784755986.387019:0:5755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755986.387038:0:5755:0:(client.c:2702:ptlrpc_set_wait()) set 000000005cee311f going to sleep for 11 seconds 00000100:00100000:2.0:1784755986.387089:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237202304 00000100:00100000:2.0:1784755986.387100:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237202304 00000100:00100000:2.0:1784755986.387127:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784755986.387133:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c89606fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+8:5755:x1871452237202304:12345-0@lo:501: 00000100:00100000:2.0:1784755986.387350:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c89606fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+9:5755:x1871452237202304:12345-0@lo:501: Request processed in 217us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755986.387358:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784755986.387485:0:5755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d8d54385 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:5755:1871452237202304:0@lo:501: 00000100:00100000:3.0:1784755986.387513:0:5755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d8d54385 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:5755:1871452237202432:0@lo:503: 00000100:00100000:3.0:1784755986.387665:0:5755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755986.387692:0:5755:0:(client.c:2702:ptlrpc_set_wait()) set 000000005cee311f going to sleep for 11 seconds 00000100:00100000:2.0:1784755986.387748:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237202432 00000100:00100000:2.0:1784755986.387753:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237202432 00000100:00100000:2.0:1784755986.387780:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784755986.387787:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011f11331 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+9:5755:x1871452237202432:12345-0@lo:503: 00000100:00100000:2.0:1784755986.387979:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011f11331 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+9:5755:x1871452237202432:12345-0@lo:503: Request processed in 193us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755986.387987:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784755986.388174:0:5755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d8d54385 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:5755:1871452237202432:0@lo:503: 00000100:00100000:0.0:1784755986.388758:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000caed9fb5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:5797:1871452237202560:0@lo:502: 00000100:00100000:0.0:1784755986.388800:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755986.388867:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c3fb611b going to sleep for 11 seconds 00000100:00100000:3.0:1784755986.388907:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237202560 00000100:00100000:3.0:1784755986.388913:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237202560 00000100:00100000:3.0:1784755986.388985:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784755986.388993:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d69a8d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+9:5797:x1871452237202560:12345-0@lo:502: 00000100:00100000:3.0:1784755986.389168:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d69a8d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+9:5797:x1871452237202560:12345-0@lo:502: Request processed in 176us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755986.389175:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784755986.389259:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000caed9fb5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:5797:1871452237202560:0@lo:502: 00000020:01000000:0.0:1784755986.389283:0:5797:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784755986.389294:0:5797:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784755986.389296:0:5797:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1784755986.389302:0:5797:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1784755986.389304:0:5797:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784755986.389317:0:5797:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000005d9f995f) 00000020:00000080:0.0:1784755986.389335:0:5797:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1784755986.389341:0:5797:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1784755986.389449:0:5797:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:0.0:1784755986.389457:0:5797:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc0f560bd53f8d84 00000020:00000080:0.0:1784755986.389688:0:5797:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1784755986.389693:0:5797:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784755986.389697:0:5797:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784755986.389698:0:5797:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1784755986.389701:0:5797:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784755986.389705:0:5797:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784755986.389706:0:5797:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1784755986.389709:0:5797:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784755986.389716:0:5797:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000e1934570) 00000020:00000080:0.0:1784755986.389726:0:5797:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1784755986.389737:0:5797:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1784755986.389739:0:5797:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1784755986.389741:0:5797:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1784755986.389747:0:5797:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1784755986.389795:0:5797:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000357b77f2 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1784755986.389807:0:5797:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000e8137f34) 00000020:00000080:0.0:1784755986.389814:0:5797:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1784755986.389860:0:5797:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1784755986.389864:0:5797:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc0f560bd53f8d99 00000020:00000080:0.0:1784755986.389950:0:5797:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1784755986.389955:0:5797:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1784755986.389960:0:5797:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc0f560bd53f8da0 00080000:01000000:0.0:1784755986.389965:0:5797:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:0.0:1784755986.389967:0:5797:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc0f560bd53f8da7 00080000:10000000:0.0:1784755986.390323:0:5797:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1784755986.390557:0:5797:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1784755986.401790:0:5797:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1784755986.506265:0:5797:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1784755986.507044:0:5797:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1784755986.509849:0:5797:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1784755986.510102:0:5797:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1784755986.525714:0:5797:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000e56da5ff) 00000020:00000080:3.0:1784755986.525741:0:5797:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1784755986.525797:0:5797:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:3.0:1784755986.525802:0:5797:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc0f560bd53f8db5 00000020:00000080:1.0:1784755986.526166:0:5797:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1784755986.527375:0:5797:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1784755986.549623:0:5797:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1784755986.581981:0:5797:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1784755986.611931:0:5797:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1784755986.648468:0:5797:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1784755986.685805:0:5797:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1784755986.712861:0:5797:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc0f560bd53f8dbc 00000020:00000080:3.0:1784755986.713254:0:5797:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1784755986.713266:0:5797:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784755986.713272:0:5797:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784755986.713274:0:5797:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1784755986.713277:0:5797:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784755986.713281:0:5797:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784755986.713282:0:5797:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784755986.713284:0:5797:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784755986.713286:0:5797:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1784755986.713288:0:5797:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784755986.713290:0:5797:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784755986.713291:0:5797:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:3.0:1784755986.713293:0:5797:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784755986.713297:0:5797:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784755986.713298:0:5797:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1784755986.713302:0:5797:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1784755986.713338:0:5797:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1784755986.713394:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d8d54385 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:5797:1871452237202688:0@lo:502: 00000100:00100000:3.0:1784755986.713499:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755986.713695:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set 00000000146b479b going to sleep for 11 seconds 00000100:00100000:0.0:1784755986.713809:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237202688 00000100:00100000:0.0:1784755986.713815:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237202688 00000100:00100000:0.0:1784755986.713894:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784755986.713903:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000181a2de6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+9:5797:x1871452237202688:12345-0@lo:502: 00000100:00100000:0.0:1784755986.714287:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000181a2de6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+9:5797:x1871452237202688:12345-0@lo:502: Request processed in 386us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755986.714297:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784755986.714386:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d8d54385 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:5797:1871452237202688:0@lo:502: 00000020:01000000:3.0:1784755986.714438:0:5797:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784755986.714444:0:5797:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784755986.714446:0:5797:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1784755986.714450:0:5797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1784755986.714661:0:5755:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1784755986.714681:0:5755:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1784755986.714701:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 00000000edfe06f0/0xc0f560bd53f8d6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8d76 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755986.714712:0:5755:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: 00000000edfe06f0/0xc0f560bd53f8d6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8d76 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784755986.714719:0:5755:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8913516af000 from 1 10000000:01000000:1.0:1784755986.714722:0:5755:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784755986.714760:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 00000000c4295896/0xc0f560bd53f8dc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755986.714767:0:5755:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 00000000c4295896/0xc0f560bd53f8dc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755986.714775:0:5755:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 00000000c4295896/0xc0f560bd53f8dc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755986.714788:0:5755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000044e636ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:5755:1871452237202816:0@lo:101: 00000100:00100000:1.0:1784755986.714819:0:5755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755986.714984:0:5755:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e4692ae4 going to sleep for 11 seconds 00000100:00100000:2.0:1784755986.715077:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237202816 00000100:00100000:2.0:1784755986.715082:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237202816 00000100:00100000:2.0:1784755986.715106:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784755986.715112:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000053701a0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+9:5755:x1871452237202816:12345-0@lo:101: 00010000:00010000:2.0:1784755986.715122:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784755986.715146:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000949130d7/0xc0f560bd53f8dca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0f560bd53f8dc3 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755986.715165:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000949130d7/0xc0f560bd53f8dca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0f560bd53f8dc3 expref: 10 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755986.715175:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000949130d7/0xc0f560bd53f8dca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8dc3 expref: 10 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755986.715217:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000949130d7, rc 0) 00000100:00100000:2.0:1784755986.715297:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000053701a0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+10:5755:x1871452237202816:12345-0@lo:101: Request processed in 185us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755986.715303:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784755986.716335:0:5755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000044e636ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:5755:1871452237202816:0@lo:101: 00010000:00010000:1.0:1784755986.716368:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 00000000c4295896/0xc0f560bd53f8dc3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8dca expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755986.716378:0:5755:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 00000000c4295896/0xc0f560bd53f8dc3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0f560bd53f8dca expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755986.716976:0:5755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000044e636ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:5755:1871452237202944:0@lo:256: 00000100:00100000:1.0:1784755986.717027:0:5755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755986.717066:0:5755:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e4692ae4 going to sleep for 11 seconds 00000100:00100000:3.0:1784755986.717311:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237202944 00000100:00100000:3.0:1784755986.717318:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237202944 00000100:00100000:3.0:1784755986.717366:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784755986.717374:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af7ea6bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+10:5755:x1871452237202944:12345-0@lo:256: 20000000:01000000:3.0:1784755986.717392:0:5769:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1784755986.717398:0:5769:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1784755986.717497:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af7ea6bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+10:5755:x1871452237202944:12345-0@lo:256: Request processed in 124us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755986.717505:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784755986.717698:0:5755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000044e636ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:5755:1871452237202944:0@lo:256: 10000000:01000000:1.0:1784755986.718478:0:5755:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784755986.718494:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 00000000c4295896/0xc0f560bd53f8dc3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8dca expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755986.718504:0:5755:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: 00000000c4295896/0xc0f560bd53f8dc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8dca expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784755986.718511:0:5755:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8913516af000 from 1 10000000:01000000:1.0:1784755986.718514:0:5755:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784755986.718664:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 00000000f0f578e3/0xc0f560bd53f8dd1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755986.718673:0:5755:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 00000000f0f578e3/0xc0f560bd53f8dd1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755986.718682:0:5755:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 00000000f0f578e3/0xc0f560bd53f8dd1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755986.718701:0:5755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000044e636ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:5755:1871452237203072:0@lo:101: 00000100:00100000:1.0:1784755986.718758:0:5755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755986.718826:0:5755:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e4692ae4 going to sleep for 11 seconds 00000100:00100000:3.0:1784755986.718926:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237203072 00000100:00100000:3.0:1784755986.718932:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237203072 00000100:00100000:3.0:1784755986.719008:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784755986.719016:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e39acaab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+10:5755:x1871452237203072:12345-0@lo:101: 00010000:00010000:3.0:1784755986.719026:0:5767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784755986.719040:0:5767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000004bb5d96/0xc0f560bd53f8dd8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0f560bd53f8dd1 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755986.719060:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000004bb5d96/0xc0f560bd53f8dd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0f560bd53f8dd1 expref: 11 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755986.719068:0:5767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000004bb5d96/0xc0f560bd53f8dd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8dd1 expref: 11 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755986.719087:0:5767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000004bb5d96, rc 0) 00000100:00100000:3.0:1784755986.719233:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e39acaab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+11:5755:x1871452237203072:12345-0@lo:101: Request processed in 217us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755986.719239:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784755986.719316:0:5755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000044e636ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:5755:1871452237203072:0@lo:101: 00010000:00010000:1.0:1784755986.719329:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 00000000f0f578e3/0xc0f560bd53f8dd1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8dd8 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755986.719338:0:5755:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 00000000f0f578e3/0xc0f560bd53f8dd1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0f560bd53f8dd8 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755986.719391:0:5755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000044e636ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:5755:1871452237203200:0@lo:501: 00000100:00100000:1.0:1784755986.719462:0:5755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755986.719481:0:5755:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e4692ae4 going to sleep for 11 seconds 00000100:00100000:0.0:1784755986.719617:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237203200 00000100:00100000:0.0:1784755986.719622:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237203200 00000100:00100000:0.0:1784755986.719692:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784755986.719699:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf070566 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+11:5755:x1871452237203200:12345-0@lo:501: 00000100:00100000:0.0:1784755986.720281:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf070566 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+11:5755:x1871452237203200:12345-0@lo:501: Request processed in 582us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755986.720298:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784755986.720447:0:5755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000044e636ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:5755:1871452237203200:0@lo:501: 00000100:00100000:1.0:1784755986.720485:0:5755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000044e636ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:5755:1871452237203328:0@lo:503: 00000100:00100000:1.0:1784755986.720523:0:5755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755986.720640:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237203328 00000100:00100000:0.0:1784755986.720645:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237203328 00000100:00100000:0.0:1784755986.720666:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784755986.720671:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024071bad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+11:5755:x1871452237203328:12345-0@lo:503: 00000040:00080000:0.0:1784755986.720703:0:5768:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784755986.720795:0:5755:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e4692ae4 going to sleep for 11 seconds 00000100:00100000:0.0:1784755986.720949:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024071bad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+11:5755:x1871452237203328:12345-0@lo:503: Request processed in 278us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755986.720956:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784755986.721014:0:5755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000044e636ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:5755:1871452237203328:0@lo:503: 00000040:00080000:3.0:1784755986.722305:0:5801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1784755986.722673:0:5755:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1784755986.722692:0:5755:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784755986.722744:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 00000000f0f578e3/0xc0f560bd53f8dd1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8dd8 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755986.722755:0:5755:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: 00000000f0f578e3/0xc0f560bd53f8dd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8dd8 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784755986.722795:0:5755:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784755986.722798:0:5755:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8913516af000 10000000:01000000:1.0:1784755986.722810:0:5755:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8913516af000 10000000:01000000:1.0:1784755986.722814:0:5755:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784755986.722821:0:5755:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8913516af000 from 1 10000000:01000000:1.0:1784755986.722823:0:5755:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784755986.722853:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 000000001ecb1916/0xc0f560bd53f8ddf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755986.722860:0:5755:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 000000001ecb1916/0xc0f560bd53f8ddf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755986.722868:0:5755:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 000000001ecb1916/0xc0f560bd53f8ddf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755986.722884:0:5755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000044e636ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:5755:1871452237203456:0@lo:101: 00000100:00100000:1.0:1784755986.722932:0:5755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755986.722972:0:5755:0:(client.c:2702:ptlrpc_set_wait()) set 000000004869a918 going to sleep for 11 seconds 00000100:00100000:0.0:1784755986.723017:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237203456 00000100:00100000:0.0:1784755986.723022:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237203456 00000100:00100000:0.0:1784755986.723060:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784755986.723066:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b175e35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+11:5755:x1871452237203456:12345-0@lo:101: 00010000:00010000:0.0:1784755986.723077:0:5767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784755986.723087:0:5767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f66b3e0c/0xc0f560bd53f8de6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0f560bd53f8ddf expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755986.723107:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f66b3e0c/0xc0f560bd53f8de6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0f560bd53f8ddf expref: 12 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755986.723115:0:5767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f66b3e0c/0xc0f560bd53f8de6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8ddf expref: 12 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755986.723123:0:5767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f66b3e0c, rc 0) 00000100:00100000:0.0:1784755986.723282:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b175e35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+12:5755:x1871452237203456:12345-0@lo:101: Request processed in 216us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755986.723289:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784755986.723358:0:5755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000044e636ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:5755:1871452237203456:0@lo:101: 00010000:00010000:1.0:1784755986.723370:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 000000001ecb1916/0xc0f560bd53f8ddf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8de6 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755986.723378:0:5755:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 000000001ecb1916/0xc0f560bd53f8ddf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0f560bd53f8de6 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755986.723447:0:5755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000044e636ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:5755:1871452237203584:0@lo:501: 00000100:00100000:1.0:1784755986.723470:0:5755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755986.723485:0:5755:0:(client.c:2702:ptlrpc_set_wait()) set 000000004869a918 going to sleep for 11 seconds 00000100:00100000:0.0:1784755986.723629:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237203584 00000100:00100000:0.0:1784755986.723640:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237203584 00000100:00100000:0.0:1784755986.723698:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784755986.723705:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007e09a869 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+12:5755:x1871452237203584:12345-0@lo:501: 00000100:00100000:0.0:1784755986.723934:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007e09a869 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+12:5755:x1871452237203584:12345-0@lo:501: Request processed in 229us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755986.723941:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784755986.723997:0:5755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000044e636ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:5755:1871452237203584:0@lo:501: 00000100:00100000:1.0:1784755986.724024:0:5755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000044e636ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:5755:1871452237203712:0@lo:503: 00000100:00100000:1.0:1784755986.724065:0:5755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755986.724321:0:5755:0:(client.c:2702:ptlrpc_set_wait()) set 000000004869a918 going to sleep for 11 seconds 00000100:00100000:2.0:1784755986.724349:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237203712 00000100:00100000:2.0:1784755986.724353:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237203712 00000100:00100000:3.0:1784755986.724396:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784755986.724403:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000913359c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+12:5755:x1871452237203712:12345-0@lo:503: 00000100:00100000:3.0:1784755986.724753:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000913359c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+12:5755:x1871452237203712:12345-0@lo:503: Request processed in 351us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755986.724761:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784755986.724912:0:5755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000044e636ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:5755:1871452237203712:0@lo:503: 00000100:00100000:0.0:1784755986.725583:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000caed9fb5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:5802:1871452237203840:0@lo:502: 00000100:00100000:0.0:1784755986.725631:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755986.726160:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set 00000000050291af going to sleep for 11 seconds 00000100:00100000:3.0:1784755986.726287:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237203840 00000100:00100000:3.0:1784755986.726293:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237203840 00000100:00100000:3.0:1784755986.726324:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784755986.726331:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4a487c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+12:5802:x1871452237203840:12345-0@lo:502: 00000100:00100000:3.0:1784755986.726664:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4a487c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+12:5802:x1871452237203840:12345-0@lo:502: Request processed in 333us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755986.726672:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784755986.726777:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000caed9fb5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:5802:1871452237203840:0@lo:502: 00000020:01000004:0.0:1784755986.726838:0:5802:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1784755986.726861:0:5802:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000004c65562d) 00000020:00000080:0.0:1784755986.727118:0:5802:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1784755986.730504:0:5802:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000357b77f2 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1784755986.730514:0:5802:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000357b77f2 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1784755986.730517:0:5802:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000357b77f2 4 00010000:00080000:0.0:1784755986.730614:0:5802:0:(ldlm_lib.c:102:import_set_conn()) imp 000000007727508b@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.141@tcp at head 00010000:00010000:1.0:1784755986.736359:0:5802:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1784755986.736859:0:5802:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1784755986.736900:0:5802:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784755986.736914:0:5802:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc0f560bd53f8df4 00000100:00080000:1.0:1784755986.736925:0:5802:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784755986.736930:0:5802:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000007727508b using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1784755986.736966:0:5802:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000044e636ab x1871452237203968/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784755986.737027:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000044e636ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3289:1871452237203968:0@lo:38: 00000100:00100000:2.0:1784755986.737111:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784755986.737786:0:5802:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1784755986.738001:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237203968 00000100:00100000:0.0:1784755986.738009:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237203968 00000100:00100000:0.0:1784755986.738041:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784755986.738047:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f572f201 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3289:x1871452237203968:12345-0@lo:38: 00000100:00100000:1.0:1784755986.738401:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008c4a1cc4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:5802:1871452237204096:0@lo:502: 00000100:00100000:1.0:1784755986.738474:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755986.738503:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237204096 00000100:00100000:1.0:1784755986.738507:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237204096 00000100:00100000:1.0:1784755986.738550:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784755986.738558:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000086b2577 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+12:5802:x1871452237204096:12345-0@lo:502: 00000100:00100000:1.0:1784755986.738771:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000086b2577 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+12:5802:x1871452237204096:12345-0@lo:502: Request processed in 214us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755986.738778:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784755986.738826:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set 000000004869a918 going to sleep for 11 seconds 00000100:00100000:1.0:1784755986.738848:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008c4a1cc4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:5802:1871452237204096:0@lo:502: 00000040:00080000:1.0:1784755986.738874:0:5802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1784755986.738923:0:5755:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1784755986.738941:0:5755:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784755986.738960:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 000000001ecb1916/0xc0f560bd53f8ddf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8de6 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755986.738971:0:5755:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: 000000001ecb1916/0xc0f560bd53f8ddf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8de6 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1784755986.739012:0:5755:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1784755986.739014:0:5755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784755986.739015:0:5755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784755986.739016:0:5755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784755986.739018:0:5755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784755986.739019:0:5755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784755986.739020:0:5755:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784755986.739021:0:5755:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784755986.739022:0:5755:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784755986.739023:0:5755:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784755986.739025:0:5755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784755986.739026:0:5755:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784755986.739029:0:5755:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1784755986.739032:0:5755:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784755986.739033:0:5755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784755986.739034:0:5755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784755986.739035:0:5755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784755986.739036:0:5755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784755986.739037:0:5755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784755986.739038:0:5755:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784755986.739039:0:5755:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784755986.739039:0:5755:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784755986.739040:0:5755:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784755986.739041:0:5755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784755986.739042:0:5755:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784755986.739053:0:5755:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1784755986.739061:0:5755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008c4a1cc4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:5755:1871452237204224:0@lo:253: 00000100:00100000:1.0:1784755986.739089:0:5755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755986.739104:0:5755:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e4692ae4 going to sleep for 11 seconds 00000100:00100000:1.0:1784755986.739124:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237204224 00000100:00100000:1.0:1784755986.739267:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237204224 00000100:00100000:1.0:1784755986.739300:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784755986.739304:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee2018c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+12:5755:x1871452237204224:12345-0@lo:253: 20000000:01000000:1.0:1784755986.739333:0:5767:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1784755986.739346:0:5767:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1784755986.740955:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f572f201 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3289:x1871452237203968:12345-0@lo:38: Request processed in 2902us (3839us total) trans 0 rc -11/-11 00000100:00100000:0.0:1784755986.740970:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784755986.741225:0:3289:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784755986.741234:0:3289:0:(import.c:65:import_set_state_nolock()) 000000007727508b lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784755986.741239:0:3289:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1784755986.741242:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000044e636ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3289:1871452237203968:0@lo:38: 20000000:01000000:0.0:1784755986.770392:0:5767:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784755986.770409:0:5767:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1784755986.770523:0:5790:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784755986.770528:0:5790:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784755986.770552:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d2a3f6a2/0xc0f560bd53f8dfb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755986.770585:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000949130d7/0xc0f560bd53f8dca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8dc3 expref: 12 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755986.770593:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000d2a3f6a2/0xc0f560bd53f8dfb lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755986.770629:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000949130d7/0xc0f560bd53f8dca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0f560bd53f8dc3 expref: 12 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755986.770642:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000949130d7/0xc0f560bd53f8dca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0f560bd53f8dc3 expref: 12 pid: 5769 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755986.770656:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d8d54385 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5790:1871452237204352:0@lo:104: 00000100:00100000:3.0:1784755986.770715:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755986.770770:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cb913601 going to sleep for 11 seconds 00000100:00100000:0.0:1784755986.770897:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237204352 00000100:00100000:0.0:1784755986.770905:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237204352 00000100:00100000:0.0:1784755986.770962:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784755986.770969:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f32738c5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3a5739ad-a70a-4582-8756-59cdd498af45+3:5790:x1871452237204352:12345-0@lo:104: 00010000:00010000:0.0:1784755986.770980:0:5757:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: 00000000c4295896/0xc0f560bd53f8dc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f8dca expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755986.771028:0:5757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784755986.771033:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f32738c5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3a5739ad-a70a-4582-8756-59cdd498af45+3:5790:x1871452237204352:12345-0@lo:104: Request processed in 65us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755986.771039:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1784755986.771056:0:5762:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784755986.771060:0:5762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: 00000000c4295896/0xc0f560bd53f8dc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f8dca expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755986.771066:0:5762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c4295896 already unused, calling callback (00000000f51bec29) 10000000:00010000:0.0:1784755986.771069:0:5762:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: 00000000c4295896/0xc0f560bd53f8dc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0f560bd53f8dca expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755986.771076:0:5762:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: 00000000c4295896/0xc0f560bd53f8dc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0f560bd53f8dca expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784755986.771082:0:5762:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: 00000000c4295896/0xc0f560bd53f8dc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0f560bd53f8dca expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784755986.771088:0:5762:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784755986.771111:0:5762:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: 00000000c4295896/0xc0f560bd53f8dc3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8dca expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755986.771117:0:5762:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1784755986.771815:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d8d54385 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5790:1871452237204352:0@lo:104: 00010000:00010000:1.0:1784755986.771836:0:5790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000d2a3f6a2/0xc0f560bd53f8dfb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755986.772463:0:5762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: 00000000c4295896/0xc0f560bd53f8dc3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8dca expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755986.772489:0:5762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: 00000000c4295896/0xc0f560bd53f8dc3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8dca expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755986.772508:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755986.772509:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755986.772511:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784755986.772714:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000caed9fb5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3a5739ad-a70a-4582-8756-59cdd498af45:3291:1871452237204480:0@lo:103: 00000100:00100000:0.0:1784755986.772763:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755986.772854:0:5759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237204480 00000100:00100000:3.0:1784755986.772860:0:5759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237204480 00010000:00010000:3.0:1784755986.772885:0:5759:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000949130d7/0xc0f560bd53f8dca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f8dc3 expref: 13 pid: 5769 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755986.772913:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784755986.772920:0:5759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004815f158 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a5739ad-a70a-4582-8756-59cdd498af45+13:3291:x1871452237204480:12345-0@lo:103: 00010000:00010000:3.0:1784755986.772933:0:5759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784755986.772938:0:5759:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000949130d7/0xc0f560bd53f8dca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f8dc3 expref: 13 pid: 5769 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755986.772947:0:5759:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000949130d7/0xc0f560bd53f8dca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0f560bd53f8dc3 expref: 13 pid: 5769 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755986.772972:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000949130d7/0xc0f560bd53f8dca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0f560bd53f8dc3 expref: 13 pid: 5769 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755986.772986:0:5759:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000d2a3f6a2/0xc0f560bd53f8dfb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755986.772993:0:5759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d2a3f6a2/0xc0f560bd53f8dfb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784755986.773006:0:5759:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002478927s 00010000:00010000:3.0:1784755986.773010:0:5759:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d2a3f6a2/0xc0f560bd53f8dfb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755986.773015:0:5759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d2a3f6a2/0xc0f560bd53f8dfb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755986.773022:0:5759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d2a3f6a2/0xc0f560bd53f8dfb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755986.773027:0:5759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d2a3f6a2/0xc0f560bd53f8dfb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755986.773032:0:5759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d2a3f6a2 already unused, calling callback (00000000a63d5d09) 00010000:00010000:3.0:1784755986.773035:0:5759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d2a3f6a2/0xc0f560bd53f8dfb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755986.773041:0:5759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d2a3f6a2/0xc0f560bd53f8dfb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755986.773064:0:5759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d2a3f6a2/0xc0f560bd53f8dfb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755986.773085:0:5759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784755986.773117:0:5759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004815f158 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a5739ad-a70a-4582-8756-59cdd498af45+12:3291:x1871452237204480:12345-0@lo:103: Request processed in 197us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755986.773124:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784755986.773301:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000caed9fb5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3a5739ad-a70a-4582-8756-59cdd498af45:3291:1871452237204480:0@lo:103: 00010000:00010000:0.0:1784755986.773323:0:5790:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000d2a3f6a2/0xc0f560bd53f8dfb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755986.773329:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d2a3f6a2/0xc0f560bd53f8dfb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755986.773334:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d2a3f6a2/0xc0f560bd53f8dfb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755986.782355:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee2018c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+11:5755:x1871452237204224:12345-0@lo:253: Request processed in 43041us (43256us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755986.782382:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784755986.782835:0:5755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008c4a1cc4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:5755:1871452237204224:0@lo:253: 10000000:01000000:1.0:1784755986.782851:0:5755:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1784755986.782854:0:5755:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784755986.782856:0:5755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784755986.782858:0:5755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784755986.782859:0:5755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784755986.782860:0:5755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784755986.782862:0:5755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784755986.782863:0:5755:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784755986.782864:0:5755:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784755986.782866:0:5755:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784755986.782867:0:5755:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784755986.782868:0:5755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784755986.782870:0:5755:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1784755986.782885:0:5755:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1784755986.791819:0:5755:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1784755986.792305:0:5755:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1784755986.792712:0:5755:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1784755986.792892:0:5755:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1784755986.793097:0:5755:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1784755986.793354:0:5755:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1784755986.794290:0:5755:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1784755986.794573:0:5755:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1784755986.794803:0:5755:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1784755986.794981:0:5755:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1784755986.795285:0:5755:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1784755986.795508:0:5755:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00010000:00010000:0.0:1784755986.808565:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:1.0:1784755986.838311:0:5755:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1784755986.873108:0:5755:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1784755986.873475:0:5808:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1784755986.875661:0:5755:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1784755986.875812:0:5755:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1784755986.876256:0:5755:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1784755986.876263:0:5755:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1784755986.876517:0:5755:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:2.0:1784755986.880975:0:5807:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1784755986.880986:0:5807:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:3.0:1784755986.881717:0:5755:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1784755986.882273:0:5755:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1784755986.882305:0:5755:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1784755986.882890:0:5755:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1784755986.883406:0:5755:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1784755986.889803:0:5755:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1784755986.890034:0:5755:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1784755986.893901:0:5755:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1784755986.894144:0:5755:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1784755986.895214:0:5755:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1784755986.895384:0:5755:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1784755986.896813:0:5755:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1784755986.896973:0:5755:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1784755986.897149:0:5755:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1784755986.897304:0:5755:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1784755986.897503:0:5755:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1784755986.899118:0:5755:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1784755986.900925:0:5755:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1784755986.901112:0:5755:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1784755986.901272:0:5755:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1784755986.901452:0:5755:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1784755986.902893:0:5755:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1784755986.903069:0:5755:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1784755986.903236:0:5755:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1784755986.903384:0:5755:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1784755986.903751:0:5755:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1784755986.903886:0:5755:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1784755986.904032:0:5755:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1784755986.904163:0:5755:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1784755986.904316:0:5755:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1784755986.904493:0:5755:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1784755986.906859:0:5755:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1784755986.907057:0:5755:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1784755986.908683:0:5755:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1784755986.908881:0:5755:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1784755986.909031:0:5755:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1784755986.909159:0:5755:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1784755986.910944:0:5755:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1784755986.942661:0:5808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1784755986.997319:0:5755:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1784755986.997894:0:5755:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaa0f42f37988 00100000:10000000:1.0:1784755986.997903:0:5755:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1784755987.001845:0:5755:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1784755987.001862:0:5755:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.141@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1784755987.001875:0:5755:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1784755987.001900:0:5755:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1784755987.065192:0:5808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1784755987.065277:0:5808:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:1.0:1784755987.065282:0:5808:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1784755987.829865:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755988.851658:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755989.880160:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755990.915765:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784755991.879741:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1784755991.879750:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784755991.879753:0:37:0:(import.c:65:import_set_state_nolock()) 000000007727508b lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784755991.879763:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000007727508b using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1784755991.879782:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000801e2418 x1871452237204736/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784755991.879827:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000801e2418 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3289:1871452237204736:0@lo:38: 00000100:00100000:3.0:1784755991.879887:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755991.879957:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237204736 00000100:00100000:3.0:1784755991.879965:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237204736 00000100:00100000:3.0:1784755991.880000:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784755991.880007:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be07827e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3289:x1871452237204736:12345-0@lo:38: 00010000:00080000:3.0:1784755991.880033:0:5776:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 109 last 0 00000020:00000080:3.0:1784755991.880069:0:5776:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc0f560bd53f8e02 00000004:00100000:3.0:1784755991.880106:0:5776:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784755991.880239:0:5776:0:(import.c:65:import_set_state_nolock()) 000000003576e5cd : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784755991.880305:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be07827e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1871452237204736:12345-0@lo:38: Request processed in 297us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755991.880313:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1784755991.880362:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000801e2418 x1871452237204736/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784756001 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784755991.880377:0:3289:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1784755991.880446:0:3289:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1784755991.880451:0:3289:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1784755991.880453:0:3289:0:(import.c:65:import_set_state_nolock()) 000000007727508b lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784755991.880458:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000801e2418 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3289:1871452237204736:0@lo:38: 00000100:00100000:3.0:1784755991.880535:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000895f37f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a5739ad-a70a-4582-8756-59cdd498af45:3292:1871452237204608:0@lo:400: 00000100:00100000:3.0:1784755991.880565:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755991.880599:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237204608 00000100:00100000:3.0:1784755991.880603:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237204608 00000100:00100000:3.0:1784755991.880631:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784755991.880643:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020abd9df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+11:3292:x1871452237204608:12345-0@lo:400: 00000100:00100000:3.0:1784755991.880676:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020abd9df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+11:3292:x1871452237204608:12345-0@lo:400: Request processed in 34us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755991.880682:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784755991.880713:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000895f37f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a5739ad-a70a-4582-8756-59cdd498af45:3292:1871452237204608:0@lo:400: 00010000:00010000:0.0:1784755991.923654:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784755992.371527:0:5772:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784755992.371535:0:5772:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8913516af000 from 3 10000000:01000000:1.0:1784755992.371540:0:5772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784755992.371588:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 0000000028102d31/0xc0f560bd53f8e09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755992.371601:0:5772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 0000000028102d31/0xc0f560bd53f8e09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755992.371611:0:5772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 0000000028102d31/0xc0f560bd53f8e09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755992.371636:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008c4a1cc4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237204864:0@lo:101: 00000100:00100000:1.0:1784755992.371703:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755992.371748:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c5bcf79c going to sleep for 11 seconds 00000100:00100000:0.0:1784755992.371898:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237204864 00000100:00100000:0.0:1784755992.371906:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237204864 00000100:00100000:0.0:1784755992.371955:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784755992.371963:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000090e61eac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+11:5772:x1871452237204864:12345-0@lo:101: 00010000:00010000:0.0:1784755992.371985:0:5767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784755992.371998:0:5767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000074425fca/0xc0f560bd53f8e10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0f560bd53f8e09 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755992.372020:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000074425fca/0xc0f560bd53f8e10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0f560bd53f8e09 expref: 12 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755992.372029:0:5767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000074425fca/0xc0f560bd53f8e10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8e09 expref: 12 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755992.372056:0:5767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000074425fca, rc 0) 00000100:00100000:0.0:1784755992.372099:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000090e61eac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+12:5772:x1871452237204864:12345-0@lo:101: Request processed in 137us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755992.372106:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784755992.372174:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008c4a1cc4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237204864:0@lo:101: 00010000:00010000:0.0:1784755992.372188:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 0000000028102d31/0xc0f560bd53f8e09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8e10 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755992.372196:0:5772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 0000000028102d31/0xc0f560bd53f8e09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0f560bd53f8e10 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755992.372242:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000caed9fb5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237204992:0@lo:256: 00000100:00100000:0.0:1784755992.372270:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755992.372286:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bf069005 going to sleep for 11 seconds 00000100:00100000:0.0:1784755992.372299:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237204992 00000100:00100000:0.0:1784755992.372302:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237204992 00000100:00100000:0.0:1784755992.372323:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784755992.372328:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d6e7b89a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+12:5772:x1871452237204992:12345-0@lo:256: 20000000:01000000:0.0:1784755992.372341:0:5768:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784755992.372371:0:5768:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784755992.372374:0:5768:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1784755992.372467:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d6e7b89a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+12:5772:x1871452237204992:12345-0@lo:256: Request processed in 139us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755992.372474:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784755992.372504:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000caed9fb5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237204992:0@lo:256: 10000000:01000000:0.0:1784755992.372543:0:5772:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784755992.372552:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 0000000028102d31/0xc0f560bd53f8e09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8e10 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755992.372559:0:5772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: 0000000028102d31/0xc0f560bd53f8e09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8e10 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:3.0:1784755992.871511:0:6051:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1784755992.951097:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755993.977517:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755994.996473:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755996.019666:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784755996.979603:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784755996.979632:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000895f37f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a5739ad-a70a-4582-8756-59cdd498af45:3292:1871452237205120:0@lo:400: 00000100:00100000:3.0:1784755996.979715:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755996.979780:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000801e2418 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3290:1871452237205248:0@lo:400: 00000100:00100000:3.0:1784755996.979809:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755996.979848:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237205120 00000100:00100000:3.0:1784755996.979855:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237205120 00000100:00100000:3.0:1784755996.979901:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784755996.979908:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000247e6105 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+12:3292:x1871452237205120:12345-0@lo:400: 00000100:00100000:3.0:1784755996.979954:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000247e6105 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+12:3292:x1871452237205120:12345-0@lo:400: Request processed in 46us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755996.979962:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784755996.979994:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237205248 00000100:00100000:3.0:1784755996.979997:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237205248 00000100:00100000:3.0:1784755996.980019:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784755996.980025:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000037aa38 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1871452237205248:12345-0@lo:400: 00000100:00100000:3.0:1784755996.980117:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000037aa38 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1871452237205248:12345-0@lo:400: Request processed in 92us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755996.980124:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1784755996.980183:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000801e2418 x1871452237205248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784756012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784755996.980208:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000801e2418 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3290:1871452237205248:0@lo:400: 00000100:00100000:3.0:1784755996.980240:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000895f37f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a5739ad-a70a-4582-8756-59cdd498af45:3292:1871452237205120:0@lo:400: 00010000:00010000:0.0:1784755997.051145:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755998.076122:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784755998.132408:0:6253:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe0e64b390 20000000:00000080:1.0:1784755998.132463:0:6253:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff89137cf5f800 uarg=0000000000000000 20000000:01000000:1.0:1784755998.132494:0:6253:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1784755998.132501:0:6253:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1784755998.132505:0:6253:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1784755998.132698:0:6253:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1784755998.132709:0:6253:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1784755998.140952:0:6253:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784755998.143741:0:6253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1784755998.143849:0:6253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1784755998.143908:0:6253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1784755998.144047:0:6253:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1784755998.144072:0:6253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c4295896/0xc0f560bd53f8e17 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755998.144100:0:6253:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000004bb5d96/0xc0f560bd53f8dd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8dd1 expref: 11 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755998.144127:0:6253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c4295896/0xc0f560bd53f8e17 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755998.144252:0:6253:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000004bb5d96/0xc0f560bd53f8dd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0f560bd53f8dd1 expref: 11 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755998.144270:0:6253:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000004bb5d96/0xc0f560bd53f8dd8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0f560bd53f8dd1 expref: 11 pid: 5767 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755998.144284:0:6253:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006d75b44c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6253:1871452237205376:0@lo:104: 00000100:00100000:1.0:1784755998.144356:0:6253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755998.144558:0:6253:0:(client.c:2702:ptlrpc_set_wait()) set 0000000095eda32d going to sleep for 11 seconds 00000100:00100000:0.0:1784755998.145031:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237205376 00000100:00100000:0.0:1784755998.145039:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237205376 00000100:00100000:0.0:1784755998.145106:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784755998.145115:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c709614 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3a5739ad-a70a-4582-8756-59cdd498af45+3:6253:x1871452237205376:12345-0@lo:104: 00010000:00010000:0.0:1784755998.145129:0:5758:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: 00000000f0f578e3/0xc0f560bd53f8dd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f8dd8 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755998.145349:0:5758:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784755998.145355:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c709614 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3a5739ad-a70a-4582-8756-59cdd498af45+3:6253:x1871452237205376:12345-0@lo:104: Request processed in 241us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755998.145361:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1784755998.145584:0:5763:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784755998.145591:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: 00000000f0f578e3/0xc0f560bd53f8dd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f8dd8 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755998.145600:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f0f578e3 already unused, calling callback (00000000f51bec29) 10000000:00010000:2.0:1784755998.145603:0:5763:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: 00000000f0f578e3/0xc0f560bd53f8dd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0f560bd53f8dd8 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755998.145611:0:5763:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: 00000000f0f578e3/0xc0f560bd53f8dd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0f560bd53f8dd8 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784755998.145618:0:5763:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: 00000000f0f578e3/0xc0f560bd53f8dd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0f560bd53f8dd8 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784755998.145625:0:5763:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784755998.145664:0:5763:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: 00000000f0f578e3/0xc0f560bd53f8dd1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8dd8 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755998.145854:0:5763:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784755998.145885:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: 00000000f0f578e3/0xc0f560bd53f8dd1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8dd8 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755998.145907:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: 00000000f0f578e3/0xc0f560bd53f8dd1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8dd8 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755998.145937:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784755998.145938:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784755998.145940:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784755998.146034:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784755998.146048:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008531d8cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a5739ad-a70a-4582-8756-59cdd498af45:3290:1871452237205504:0@lo:103: 00000100:00100000:0.0:1784755998.146123:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755998.146264:0:5759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237205504 00000100:00100000:2.0:1784755998.146270:0:5759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237205504 00010000:00010000:2.0:1784755998.146293:0:5759:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000004bb5d96/0xc0f560bd53f8dd8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f8dd1 expref: 12 pid: 5767 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755998.146326:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784755998.146333:0:5759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000caed9fb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a5739ad-a70a-4582-8756-59cdd498af45+12:3290:x1871452237205504:12345-0@lo:103: 00010000:00010000:2.0:1784755998.146344:0:5759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784755998.146349:0:5759:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000004bb5d96/0xc0f560bd53f8dd8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f8dd1 expref: 12 pid: 5767 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755998.146358:0:5759:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000004bb5d96/0xc0f560bd53f8dd8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0f560bd53f8dd1 expref: 12 pid: 5767 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755998.146374:0:5759:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c4295896/0xc0f560bd53f8e17 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755998.146641:0:5759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c4295896/0xc0f560bd53f8e17 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755998.146657:0:5759:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c4295896/0xc0f560bd53f8e17 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755998.146663:0:5759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c4295896/0xc0f560bd53f8e17 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755998.147032:0:5759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c4295896/0xc0f560bd53f8e17 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755998.147038:0:5759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c4295896/0xc0f560bd53f8e17 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755998.147043:0:5759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c4295896 already unused, calling callback (00000000a63d5d09) 00010000:00010000:2.0:1784755998.147046:0:5759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c4295896/0xc0f560bd53f8e17 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755998.147053:0:5759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c4295896/0xc0f560bd53f8e17 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755998.147061:0:5759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c4295896/0xc0f560bd53f8e17 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755998.147071:0:5759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784755998.147298:0:5759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000caed9fb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a5739ad-a70a-4582-8756-59cdd498af45+12:3290:x1871452237205504:12345-0@lo:103: Request processed in 965us (1174us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755998.147306:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1784755998.147698:0:6253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000004bb5d96/0xc0f560bd53f8dd8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0f560bd53f8dd1 expref: 11 pid: 5767 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755998.147712:0:6253:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006d75b44c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6253:1871452237205376:0@lo:104: 00010000:00010000:1.0:1784755998.147919:0:6253:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c4295896/0xc0f560bd53f8e17 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755998.147938:0:6253:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c4295896/0xc0f560bd53f8e17 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755998.147942:0:6253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c4295896/0xc0f560bd53f8e17 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755998.147947:0:6253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c4295896/0xc0f560bd53f8e17 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755998.149844:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008531d8cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a5739ad-a70a-4582-8756-59cdd498af45:3290:1871452237205504:0@lo:103: 00010000:00010000:0.0:1784755999.092734:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784755999.987500:0:5772:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784755999.987525:0:5772:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8913516af000 from 1 10000000:01000000:0.0:1784755999.987531:0:5772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784755999.987586:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 000000006a65b516/0xc0f560bd53f8e1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755999.987600:0:5772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 000000006a65b516/0xc0f560bd53f8e1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755999.987611:0:5772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 000000006a65b516/0xc0f560bd53f8e1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755999.987644:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005a265f2d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237205632:0@lo:101: 00000100:00100000:0.0:1784755999.987728:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755999.987870:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f42b52ed going to sleep for 11 seconds 00000100:00100000:1.0:1784755999.987944:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237205632 00000100:00100000:1.0:1784755999.987958:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237205632 00000100:00100000:1.0:1784755999.988011:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784755999.988020:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4e1039f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+11:5772:x1871452237205632:12345-0@lo:101: 00010000:00010000:1.0:1784755999.988033:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784755999.988046:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c4295896/0xc0f560bd53f8e25 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0f560bd53f8e1e expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755999.988103:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c4295896/0xc0f560bd53f8e25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0f560bd53f8e1e expref: 12 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755999.988113:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c4295896/0xc0f560bd53f8e25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8e1e expref: 12 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755999.988122:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c4295896, rc 0) 00000100:00100000:1.0:1784755999.988170:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4e1039f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+12:5772:x1871452237205632:12345-0@lo:101: Request processed in 152us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755999.988177:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784755999.988513:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005a265f2d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237205632:0@lo:101: 00010000:00010000:0.0:1784755999.988529:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 000000006a65b516/0xc0f560bd53f8e1e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8e25 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755999.988538:0:5772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 000000006a65b516/0xc0f560bd53f8e1e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0f560bd53f8e25 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755999.988592:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005a265f2d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237205760:0@lo:501: 00000100:00100000:0.0:1784755999.988618:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755999.988829:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237205760 00000100:00100000:3.0:1784755999.988834:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237205760 00000100:00100000:3.0:1784755999.988866:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784755999.988872:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000453ddb21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+12:5772:x1871452237205760:12345-0@lo:501: 00000100:00100000:3.0:1784755999.989120:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000453ddb21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+12:5772:x1871452237205760:12345-0@lo:501: Request processed in 248us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755999.989127:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784755999.993377:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f42b52ed going to sleep for 11 seconds 00000100:00100000:0.0:1784755999.993440:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005a265f2d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237205760:0@lo:501: 00000100:00100000:0.0:1784755999.993497:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005a265f2d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237205888:0@lo:503: 00000100:00100000:0.0:1784755999.993575:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755999.993657:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f42b52ed going to sleep for 11 seconds 00000100:00100000:3.0:1784755999.999462:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237205888 00000100:00100000:3.0:1784755999.999477:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237205888 00000100:00100000:3.0:1784755999.999532:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784755999.999540:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7c923f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+12:5772:x1871452237205888:12345-0@lo:503: 00000100:00100000:3.0:1784755999.999791:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7c923f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+12:5772:x1871452237205888:12345-0@lo:503: Request processed in 252us (6216us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755999.999800:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784756000.000171:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005a265f2d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237205888:0@lo:503: 00000100:00100000:2.0:1784756000.000830:0:6320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000069413dcc pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:6320:1871452237206016:0@lo:502: 00000100:00100000:2.0:1784756000.000888:0:6320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756000.000937:0:6320:0:(client.c:2702:ptlrpc_set_wait()) set 000000004165e4d0 going to sleep for 11 seconds 00000100:00100000:1.0:1784756000.000988:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237206016 00000100:00100000:1.0:1784756000.000994:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237206016 00000100:00100000:1.0:1784756000.001035:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784756000.001045:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005ce1b1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+12:6320:x1871452237206016:12345-0@lo:502: 00000100:00100000:1.0:1784756000.001251:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005ce1b1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+12:6320:x1871452237206016:12345-0@lo:502: Request processed in 207us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756000.001260:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784756000.001389:0:6320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000069413dcc pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:6320:1871452237206016:0@lo:502: 00000020:01000000:2.0:1784756000.001412:0:6320:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784756000.001446:0:6320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784756000.001454:0:6320:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1784756000.001463:0:6320:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8913516af000 00000020:00000080:2.0:1784756000.001466:0:6320:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784756000.001501:0:6320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346879180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:6320:1871452237206144:0@lo:502: 00000100:00100000:2.0:1784756000.001530:0:6320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756000.001546:0:6320:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913819396c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784756000.001597:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237206144 00000100:00100000:1.0:1784756000.001602:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237206144 00000100:00100000:1.0:1784756000.001636:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784756000.001643:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+12:6320:x1871452237206144:12345-0@lo:502: 00000100:00100000:1.0:1784756000.001728:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+12:6320:x1871452237206144:12345-0@lo:502: Request processed in 85us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756000.001739:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784756000.001870:0:6320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346879180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:6320:1871452237206144:0@lo:502: 00000020:01000000:2.0:1784756000.001885:0:6320:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784756000.001889:0:6320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784756000.001891:0:6320:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1784756000.001895:0:6320:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1784756000.002101:0:5772:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1784756000.002121:0:5772:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784756000.002131:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff891342bae200/0xc0f560bd53f8e1e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8e25 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756000.002144:0:5772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff891342bae200/0xc0f560bd53f8e1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8e25 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756000.118084:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756001.141464:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756002.099904:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a5739ad-a70a-4582-8756-59cdd498af45:3292:1871452237206272:0@lo:400: 00000100:00100000:2.0:1784756002.099999:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756002.100070:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784756002.100077:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3292:1871452237206400:0@lo:400: 00000100:00100000:2.0:1784756002.100108:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756002.100166:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237206400 00000100:00100000:2.0:1784756002.100175:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237206400 00000100:00100000:2.0:1784756002.100227:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784756002.100236:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346879180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1871452237206400:12345-0@lo:400: 00000100:00100000:2.0:1784756002.100294:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346879180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1871452237206400:12345-0@lo:400: Request processed in 58us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756002.100302:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1784756002.100344:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff891375a80380 x1871452237206400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784756018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756002.100359:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3292:1871452237206400:0@lo:400: 00000100:00100000:1.0:1784756002.100456:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237206272 00000100:00100000:1.0:1784756002.100461:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237206272 00000100:00100000:1.0:1784756002.100498:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784756002.100506:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+12:3292:x1871452237206272:12345-0@lo:400: 00000100:00100000:1.0:1784756002.100547:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+12:3292:x1871452237206272:12345-0@lo:400: Request processed in 43us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756002.100554:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784756002.101583:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a5739ad-a70a-4582-8756-59cdd498af45:3292:1871452237206272:0@lo:400: 00010000:00010000:3.0:1784756002.168095:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756003.191573:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1784756003.510963:0:6573:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1784756003.510967:0:6573:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1784756003.511134:0:6573:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff891342e9d800 00000020:01000004:0.0:1784756003.511151:0:6573:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1784756003.511163:0:6573:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1784756003.511177:0:6573:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8913752db380) 00000020:00000080:0.0:1784756003.511202:0:6573:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1784756003.528084:0:6573:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1784756003.528723:0:6573:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1784756003.559759:0:6573:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1784756003.572727:0:6573:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1784756003.572768:0:6573:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1784756003.572829:0:6573:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1784756003.572855:0:6573:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1784756003.573708:0:6573:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1784756003.573720:0:6573:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784756003.573738:0:6573:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc0f560bd53f8e33 00000020:01000004:3.0:1784756003.573746:0:6573:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1784756003.573767:0:6573:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.141@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1784756003.573770:0:6573:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.141@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1784756003.573777:0:6573:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1784756003.573781:0:6573:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1784756003.573792:0:6573:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff891346954d40) 00000020:00000080:3.0:1784756003.573803:0:6573:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1784756003.576726:0:6573:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784756003.577001:0:6573:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1784756003.577008:0:6573:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1784756003.580286:0:6573:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1784756003.580303:0:6573:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1784756003.581293:0:6573:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1784756003.581302:0:6573:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1784756003.587299:0:6573:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784756003.587797:0:6573:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1784756003.587804:0:6573:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1784756003.596666:0:6573:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1784756003.596706:0:6573:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1784756003.638319:0:6573:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784756003.638791:0:6573:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1784756003.638797:0:6573:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1784756003.641456:0:6573:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1784756003.641476:0:6573:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1784756003.644264:0:6573:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1784756003.644278:0:6573:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1784756003.655806:0:6573:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784756003.656176:0:6573:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1784756003.656184:0:6573:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1784756003.657218:0:6573:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1784756003.657226:0:6573:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1784756003.730044:0:6573:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784756003.730250:0:6573:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1784756003.730257:0:6573:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1784756003.731664:0:6573:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1784756003.731674:0:6573:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1784756003.732157:0:6573:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1784756003.732182:0:6573:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1784756003.732188:0:6573:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.141@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1784756003.748302:0:6573:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 00000020:01000004:1.0:1784756003.748340:0:6573:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.141@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1784756003.748344:0:6573:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1784756003.748346:0:6573:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784756003.748347:0:6573:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784756003.748349:0:6573:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784756003.748350:0:6573:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784756003.748351:0:6573:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784756003.748352:0:6573:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784756003.748354:0:6573:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784756003.748355:0:6573:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784756003.748357:0:6573:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784756003.748358:0:6573:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784756003.748361:0:6573:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1784756003.748363:0:6573:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784756003.748369:0:6573:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784756003.748369:0:6573:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784756003.748370:0:6573:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784756003.748371:0:6573:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784756003.748372:0:6573:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784756003.748373:0:6573:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784756003.748374:0:6573:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784756003.748375:0:6573:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784756003.748376:0:6573:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784756003.748377:0:6573:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784756003.748403:0:6573:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1784756003.748498:0:6573:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a83480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:6573:1871452237206528:0@lo:253: 00000100:00100000:1.0:1784756003.748571:0:6573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756003.748685:0:6573:0:(client.c:2702:ptlrpc_set_wait()) set ffff891347206480 going to sleep for 11 seconds 00000100:00100000:3.0:1784756003.748733:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237206528 00000100:00100000:3.0:1784756003.748742:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237206528 00000100:00100000:3.0:1784756003.748832:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784756003.748843:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+12:6573:x1871452237206528:12345-0@lo:253: 20000000:01000000:3.0:1784756003.748894:0:5768:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1784756003.748899:0:5768:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1784756003.748903:0:5768:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1784756003.748907:0:5768:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1784756003.749849:0:5768:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784756003.750086:0:5768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1784756003.750101:0:5768:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1784756003.750141:0:5768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1784756003.750149:0:5768:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1784756003.750177:0:5768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1784756003.750227:0:5768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1784756003.750652:0:5768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1784756003.750673:0:5768:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.141@tcp 20000000:01000000:3.0:1784756003.750675:0:5768:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.141@tcp (null) (null) (null) 00000040:00080000:3.0:1784756003.750711:0:5768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1784756003.750720:0:5768:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1784756003.750767:0:5768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1784756003.750776:0:5768:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.141@tcp (null) (null) 00000040:00080000:3.0:1784756003.750808:0:5768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1784756003.750818:0:5768:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1784756003.750852:0:5768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1784756003.750905:0:5768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1784756003.751595:0:5768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1784756003.751612:0:5768:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.141@tcp 20000000:01000000:3.0:1784756003.751614:0:5768:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.141@tcp (null) (null) (null) 00000040:00080000:3.0:1784756003.751646:0:5768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1784756003.751652:0:5768:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1784756003.751681:0:5768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1784756003.751688:0:5768:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.141@tcp (null) (null) 00000040:00080000:3.0:1784756003.751747:0:5768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1784756003.751757:0:5768:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1784756003.751800:0:5768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1784756003.751840:0:5768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1784756003.751857:0:5768:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1784756003.751861:0:5768:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1784756003.751867:0:5768:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1784756003.751869:0:5768:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1784756003.751871:0:5768:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1784756003.751885:0:5768:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1784756003.751887:0:5768:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1784756003.751920:0:5768:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1784756003.751922:0:5768:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1784756003.752691:0:6588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1784756003.752974:0:5768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1784756003.753019:0:5768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1784756003.753101:0:5768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1784756003.753114:0:5768:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1784756003.753117:0:5768:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1784756003.753757:0:6589:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1784756003.753811:0:6589:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1784756003.753873:0:6589:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1784756003.754142:0:5768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1784756003.754185:0:5768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1784756003.754242:0:5768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1784756003.754256:0:5768:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1784756003.754258:0:5768:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1784756003.754807:0:6590:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1784756003.754855:0:6590:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1784756003.754906:0:6590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1784756003.755171:0:5768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1784756003.755909:0:5768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1784756003.755962:0:5768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 10000000:01000000:3.0:1784756003.755982:0:5768:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1784756003.756001:0:5768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89134151be00/0xc0f560bd53f8e41 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.756021:0:5768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8913429e4200/0xc0f560bd53f8d5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8d53 expref: 12 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.756042:0:5768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891342bae600/0xc0f560bd53f8d76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8d6f expref: 12 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.756063:0:5768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891342baf800/0xc0f560bd53f8de6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8ddf expref: 12 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.756070:0:5768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89134151be00/0xc0f560bd53f8e41 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.756115:0:5768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891342baf800/0xc0f560bd53f8de6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0f560bd53f8ddf expref: 12 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.756132:0:5768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff891342baf800/0xc0f560bd53f8de6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0f560bd53f8ddf expref: 12 pid: 5767 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756003.756148:0:5768:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891374d65880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5768:1871452237206656:0@lo:104: 00000100:00100000:3.0:1784756003.756221:0:5768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784756003.756316:0:5768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891342bae600/0xc0f560bd53f8d76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0f560bd53f8d6f expref: 12 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.756324:0:5768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff891342bae600/0xc0f560bd53f8d76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0f560bd53f8d6f expref: 12 pid: 5768 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756003.756333:0:5768:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891374d65500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5768:1871452237206784:0@lo:104: 00000100:00100000:3.0:1784756003.756353:0:5768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784756003.756647:0:5768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8913429e4200/0xc0f560bd53f8d5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0f560bd53f8d53 expref: 12 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.756656:0:5768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8913429e4200/0xc0f560bd53f8d5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0f560bd53f8d53 expref: 12 pid: 5767 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756003.756664:0:5768:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891374d65f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5768:1871452237206912:0@lo:104: 00000100:00100000:3.0:1784756003.756693:0:5768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756003.756711:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237206656 00000100:00100000:1.0:1784756003.756717:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237206656 00000100:00100000:1.0:1784756003.756753:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237206784 00000100:00100000:1.0:1784756003.756755:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237206784 00000100:00100000:1.0:1784756003.756769:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784756003.756777:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891374d66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3a5739ad-a70a-4582-8756-59cdd498af45+4:5768:x1871452237206656:12345-0@lo:104: 00010000:00010000:1.0:1784756003.756788:0:5757:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8913429e5e00/0xc0f560bd53f8ddf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f8de6 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756003.756844:0:5757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784756003.756850:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891374d66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3a5739ad-a70a-4582-8756-59cdd498af45+4:5768:x1871452237206656:12345-0@lo:104: Request processed in 74us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756003.756858:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784756003.756880:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784756003.756886:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891374d66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3a5739ad-a70a-4582-8756-59cdd498af45+3:5768:x1871452237206784:12345-0@lo:104: 00010000:00010000:1.0:1784756003.756894:0:5757:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff89134151ac00/0xc0f560bd53f8d6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f8d76 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756003.756927:0:5757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784756003.756932:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891374d66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3a5739ad-a70a-4582-8756-59cdd498af45+3:5768:x1871452237206784:12345-0@lo:104: Request processed in 47us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756003.756938:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1784756003.756985:0:5763:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784756003.756992:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8913429e5e00/0xc0f560bd53f8ddf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f8de6 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.757000:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8913429e5e00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:2.0:1784756003.757004:0:5763:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8913429e5e00/0xc0f560bd53f8ddf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0f560bd53f8de6 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.757013:0:5763:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8913429e5e00/0xc0f560bd53f8ddf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0f560bd53f8de6 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784756003.757020:0:5763:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8913429e5e00/0xc0f560bd53f8ddf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0f560bd53f8de6 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784756003.757036:0:5763:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784756003.757071:0:5763:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8913429e5e00/0xc0f560bd53f8ddf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8de6 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.757087:0:5763:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784756003.757110:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8913429e5e00/0xc0f560bd53f8ddf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8de6 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.757117:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8913429e5e00/0xc0f560bd53f8ddf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8de6 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.757130:0:5763:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784756003.757133:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff89134151ac00/0xc0f560bd53f8d6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f8d76 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.757139:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89134151ac00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:2.0:1784756003.757142:0:5763:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff89134151ac00/0xc0f560bd53f8d6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0f560bd53f8d76 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.757148:0:5763:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff89134151ac00/0xc0f560bd53f8d6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0f560bd53f8d76 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784756003.757154:0:5763:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff89134151ac00/0xc0f560bd53f8d6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0f560bd53f8d76 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784756003.757159:0:5763:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784756003.757172:0:5763:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff89134151ac00/0xc0f560bd53f8d6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8d76 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.757178:0:5763:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784756003.757182:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff89134151ac00/0xc0f560bd53f8d6f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8d76 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.757189:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff89134151ac00/0xc0f560bd53f8d6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8d76 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.757203:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756003.757204:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756003.757205:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756003.757278:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756003.757290:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89134687a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a5739ad-a70a-4582-8756-59cdd498af45:3290:1871452237207040:0@lo:103: 00000100:00100000:0.0:1784756003.757321:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756003.757383:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784756003.757389:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89134687bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a5739ad-a70a-4582-8756-59cdd498af45:3290:1871452237207168:0@lo:103: 00000100:00100000:0.0:1784756003.757408:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756003.757532:0:5768:0:(client.c:2702:ptlrpc_set_wait()) set ffff891377e319c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784756003.757552:0:5768:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891374d65880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5768:1871452237206656:0@lo:104: 00000100:00100000:3.0:1784756003.757560:0:5768:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891374d65500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5768:1871452237206784:0@lo:104: 00000100:00100000:1.0:1784756003.757694:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237206912 00000100:00100000:1.0:1784756003.757699:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237206912 00000100:00100000:1.0:1784756003.757738:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784756003.757746:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891374d64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3a5739ad-a70a-4582-8756-59cdd498af45+3:5768:x1871452237206912:12345-0@lo:104: 00010000:00010000:1.0:1784756003.757755:0:5757:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff891342baf400/0xc0f560bd53f8d53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f8d5a expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756003.757797:0:5757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784756003.757802:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891374d64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3a5739ad-a70a-4582-8756-59cdd498af45+3:5768:x1871452237206912:12345-0@lo:104: Request processed in 58us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756003.757807:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784756003.757873:0:5768:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891374d65f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5768:1871452237206912:0@lo:104: 00010000:00010000:3.0:1784756003.757895:0:5768:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89134151be00/0xc0f560bd53f8e41 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756003.758122:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237207040 00000100:00100000:2.0:1784756003.758127:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237207040 00010000:00010000:2.0:1784756003.758148:0:5761:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891342baf800/0xc0f560bd53f8de6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f8ddf expref: 13 pid: 5767 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756003.758205:0:5760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237207168 00000100:00100000:1.0:1784756003.758209:0:5760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237207168 00010000:00010000:1.0:1784756003.758222:0:5760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891342bae600/0xc0f560bd53f8d76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f8d6f expref: 14 pid: 5768 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756003.758252:0:5760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784756003.758258:0:5760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346761880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a5739ad-a70a-4582-8756-59cdd498af45+14:3290:x1871452237207040:12345-0@lo:103: 00010000:00010000:1.0:1784756003.758268:0:5760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784756003.758279:0:5760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891342baf800/0xc0f560bd53f8de6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f8ddf expref: 14 pid: 5767 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756003.758288:0:5760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891342baf800/0xc0f560bd53f8de6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0f560bd53f8ddf expref: 14 pid: 5767 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756003.758302:0:5760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891342baf800/0xc0f560bd53f8de6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0f560bd53f8ddf expref: 14 pid: 5767 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756003.758317:0:5760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784756003.758353:0:5760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346761880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a5739ad-a70a-4582-8756-59cdd498af45+13:3290:x1871452237207040:12345-0@lo:103: Request processed in 95us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756003.758359:0:5760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784756003.758372:0:5760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784756003.758378:0:5760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346762a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a5739ad-a70a-4582-8756-59cdd498af45+12:3290:x1871452237207168:12345-0@lo:103: 00010000:00010000:1.0:1784756003.758385:0:5760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784756003.758389:0:5760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891342bae600/0xc0f560bd53f8d76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f8d6f expref: 12 pid: 5768 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756003.758396:0:5760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891342bae600/0xc0f560bd53f8d76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0f560bd53f8d6f expref: 12 pid: 5768 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756003.758406:0:5760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891342bae600/0xc0f560bd53f8d76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0f560bd53f8d6f expref: 12 pid: 5768 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756003.758470:0:5760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784756003.758491:0:5760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346762a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a5739ad-a70a-4582-8756-59cdd498af45+11:3290:x1871452237207168:12345-0@lo:103: Request processed in 113us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756003.758497:0:5760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784756003.758651:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89134687bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a5739ad-a70a-4582-8756-59cdd498af45:3290:1871452237207168:0@lo:103: 00000100:00100000:0.0:1784756003.758659:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89134687a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a5739ad-a70a-4582-8756-59cdd498af45:3290:1871452237207040:0@lo:103: 00010000:00010000:2.0:1784756003.758763:0:5763:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784756003.758769:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff891342baf400/0xc0f560bd53f8d53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f8d5a expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.758776:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891342baf400 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:2.0:1784756003.758779:0:5763:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff891342baf400/0xc0f560bd53f8d53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0f560bd53f8d5a expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.758786:0:5763:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff891342baf400/0xc0f560bd53f8d53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0f560bd53f8d5a expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784756003.758792:0:5763:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff891342baf400/0xc0f560bd53f8d53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0f560bd53f8d5a expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784756003.758797:0:5763:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784756003.758889:0:5763:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff891342baf400/0xc0f560bd53f8d53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8d5a expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.758896:0:5763:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784756003.758922:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff891342baf400/0xc0f560bd53f8d53 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8d5a expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.758940:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff891342baf400/0xc0f560bd53f8d53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8d5a expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.758953:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756003.758955:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756003.758956:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756003.758963:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784756003.758974:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89134687b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3a5739ad-a70a-4582-8756-59cdd498af45:3293:1871452237207296:0@lo:103: 00000100:00100000:2.0:1784756003.759005:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756003.759132:0:5759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237207296 00000100:00100000:3.0:1784756003.759136:0:5759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237207296 00010000:00010000:3.0:1784756003.759153:0:5759:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8913429e4200/0xc0f560bd53f8d5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f8d53 expref: 11 pid: 5767 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756003.759211:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784756003.759218:0:5759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346878700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a5739ad-a70a-4582-8756-59cdd498af45+11:3293:x1871452237207296:12345-0@lo:103: 00010000:00010000:3.0:1784756003.759226:0:5759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784756003.759230:0:5759:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8913429e4200/0xc0f560bd53f8d5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f8d53 expref: 11 pid: 5767 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.759239:0:5759:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8913429e4200/0xc0f560bd53f8d5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0f560bd53f8d53 expref: 11 pid: 5767 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.759250:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8913429e4200/0xc0f560bd53f8d5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0f560bd53f8d53 expref: 11 pid: 5767 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.759262:0:5759:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89134151be00/0xc0f560bd53f8e41 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.759269:0:5759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89134151be00/0xc0f560bd53f8e41 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.759289:0:5759:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89134151be00/0xc0f560bd53f8e41 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.759295:0:5759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89134151be00/0xc0f560bd53f8e41 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.759301:0:5759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89134151be00/0xc0f560bd53f8e41 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.759307:0:5759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89134151be00/0xc0f560bd53f8e41 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.759311:0:5759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89134151be00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:3.0:1784756003.759315:0:5759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89134151be00/0xc0f560bd53f8e41 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.759322:0:5759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89134151be00/0xc0f560bd53f8e41 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.759343:0:5759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89134151be00/0xc0f560bd53f8e41 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.759352:0:5759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784756003.759393:0:5759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346878700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a5739ad-a70a-4582-8756-59cdd498af45+10:3293:x1871452237207296:12345-0@lo:103: Request processed in 176us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756003.759400:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784756003.759473:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89134687b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3a5739ad-a70a-4582-8756-59cdd498af45:3293:1871452237207296:0@lo:103: 00010000:00010000:0.0:1784756003.759544:0:5768:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89134151be00/0xc0f560bd53f8e41 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756003.759553:0:5768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89134151be00/0xc0f560bd53f8e41 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756003.759558:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89134151be00/0xc0f560bd53f8e41 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784756003.759571:0:5768:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1784756003.805324:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+9:6573:x1871452237206528:12345-0@lo:253: Request processed in 56473us (56742us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756003.805340:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784756003.806468:0:6573:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a83480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:6573:1871452237206528:0@lo:253: 10000000:01000000:1.0:1784756003.806488:0:6573:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1784756003.806491:0:6573:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784756003.806494:0:6573:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784756003.806495:0:6573:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784756003.806497:0:6573:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1784756003.806498:0:6573:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784756003.806500:0:6573:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784756003.806502:0:6573:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784756003.806503:0:6573:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1784756003.806505:0:6573:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784756003.806506:0:6573:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1784756003.806529:0:6573:0:(tgt_mount.c:101:server_register_mount()) register mount ffff891342e9d800 from lustre-OST0000 10000000:01000000:1.0:1784756003.806557:0:6573:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1784756003.806560:0:6573:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1784756003.806569:0:6573:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff891347b0b380 local copy 10000000:01000000:1.0:1784756003.806573:0:6573:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1784756003.806611:0:6573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8913429e4a00/0xc0f560bd53f8e48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756003.806623:0:6573:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.141@tcp lock: ffff8913429e4a00/0xc0f560bd53f8e48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756003.806633:0:6573:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8913429e4a00/0xc0f560bd53f8e48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756003.806652:0:6573:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a83480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:6573:1871452237207424:0@lo:101: 00000100:00100000:1.0:1784756003.806702:0:6573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756003.806763:0:6573:0:(client.c:2702:ptlrpc_set_wait()) set ffff891347206540 going to sleep for 11 seconds 00000100:00100000:2.0:1784756003.806936:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237207424 00000100:00100000:2.0:1784756003.806942:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237207424 00000100:00100000:2.0:1784756003.806991:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784756003.807000:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+9:6573:x1871452237207424:12345-0@lo:101: 00010000:00010000:2.0:1784756003.807013:0:5767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756003.807037:0:5767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891382146400/0xc0f560bd53f8e4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0f560bd53f8e48 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.807061:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891382146400/0xc0f560bd53f8e4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0f560bd53f8e48 expref: 10 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.807072:0:5767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891382146400/0xc0f560bd53f8e4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8e48 expref: 10 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.807081:0:5767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891382146400, rc 0) 00000100:00100000:2.0:1784756003.807131:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+10:6573:x1871452237207424:12345-0@lo:101: Request processed in 132us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756003.807138:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784756003.807219:0:6573:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a83480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:6573:1871452237207424:0@lo:101: 00010000:00010000:3.0:1784756003.807245:0:6573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8913429e4a00/0xc0f560bd53f8e48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc0f560bd53f8e4f expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.807254:0:6573:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8913429e4a00/0xc0f560bd53f8e48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc0f560bd53f8e4f expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756003.807382:0:6573:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891374d65f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:6573:1871452237207552:0@lo:501: 00000100:00100000:3.0:1784756003.807445:0:6573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756003.807474:0:6573:0:(client.c:2702:ptlrpc_set_wait()) set ffff891377e31480 going to sleep for 11 seconds 00000100:00100000:1.0:1784756003.807572:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237207552 00000100:00100000:1.0:1784756003.807576:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237207552 00000100:00100000:1.0:1784756003.807606:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784756003.807618:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+10:6573:x1871452237207552:12345-0@lo:501: 00000100:00100000:1.0:1784756003.807920:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+10:6573:x1871452237207552:12345-0@lo:501: Request processed in 301us (473us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784756003.807928:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784756003.810920:0:6573:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891374d65f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:6573:1871452237207552:0@lo:501: 10000000:01000000:3.0:1784756003.810955:0:6573:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1784756003.811019:0:6573:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.141@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1784756003.811037:0:6573:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8913429e4a00/0xc0f560bd53f8e48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc0f560bd53f8e4f expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.811047:0:6573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8913429e4a00/0xc0f560bd53f8e48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc0f560bd53f8e4f expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.811054:0:6573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff8913429e4a00/0xc0f560bd53f8e48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc0f560bd53f8e4f expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.811074:0:6573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784756003.811102:0:6573:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff891342e9d800 10000000:01000000:3.0:1784756003.811108:0:6573:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784756003.811115:0:6573:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff891347b0b380 10000000:01000000:3.0:1784756003.811118:0:6573:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1784756003.811122:0:6573:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff891347b0b380 from 1 10000000:01000000:3.0:1784756003.811125:0:6573:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784756003.811166:0:6573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff89134151a800/0xc0f560bd53f8e56 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.811191:0:6573:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff89134151a800/0xc0f560bd53f8e56 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.811203:0:6573:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff89134151a800/0xc0f560bd53f8e56 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756003.811232:0:6573:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891374d65f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:6573:1871452237207680:0@lo:101: 00000100:00100000:3.0:1784756003.811287:0:6573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784756003.811456:0:5762:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784756003.811464:0:5762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8913429e4a00/0xc0f560bd53f8e48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xc0f560bd53f8e4f expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756003.811483:0:5762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8913429e4a00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:0.0:1784756003.811487:0:5762:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8913429e4a00/0xc0f560bd53f8e48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xc0f560bd53f8e4f expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756003.811495:0:5762:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8913429e4a00/0xc0f560bd53f8e48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xc0f560bd53f8e4f expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784756003.811503:0:5762:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8913429e4a00/0xc0f560bd53f8e48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xc0f560bd53f8e4f expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784756003.811509:0:5762:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784756003.811529:0:5762:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8913429e4a00/0xc0f560bd53f8e48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc0f560bd53f8e4f expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756003.811534:0:5762:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784756003.811561:0:5762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8913429e4a00/0xc0f560bd53f8e48 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc0f560bd53f8e4f expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756003.811569:0:5762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8913429e4a00/0xc0f560bd53f8e48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc0f560bd53f8e4f expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756003.811586:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756003.811588:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756003.811590:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756003.811599:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784756003.811610:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346760380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a5739ad-a70a-4582-8756-59cdd498af45:3292:1871452237207808:0@lo:103: 00000100:00100000:0.0:1784756003.811638:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756003.811677:0:5760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237207808 00000100:00100000:0.0:1784756003.811684:0:5760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237207808 00000100:00100000:0.0:1784756003.811739:0:5760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784756003.811747:0:5760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346763480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a5739ad-a70a-4582-8756-59cdd498af45+10:3292:x1871452237207808:12345-0@lo:103: 00010000:00010000:0.0:1784756003.811760:0:5760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784756003.811772:0:5760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891382146400/0xc0f560bd53f8e4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc0f560bd53f8e48 expref: 10 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756003.811789:0:5760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784756003.811817:0:5760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346763480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a5739ad-a70a-4582-8756-59cdd498af45+9:3292:x1871452237207808:12345-0@lo:103: Request processed in 70us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756003.811824:0:5760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784756003.811855:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346760380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a5739ad-a70a-4582-8756-59cdd498af45:3292:1871452237207808:0@lo:103: 00000100:00100000:2.0:1784756003.812006:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237207680 00000100:00100000:2.0:1784756003.812017:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237207680 00000100:00100000:2.0:1784756003.812053:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784756003.812060:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346889050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+9:6573:x1871452237207680:12345-0@lo:101: 00010000:00010000:2.0:1784756003.812072:0:5767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756003.812085:0:5767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891382146000/0xc0f560bd53f8e5d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0f560bd53f8e56 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.812104:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891382146000/0xc0f560bd53f8e5d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0f560bd53f8e56 expref: 10 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.812113:0:5767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891382146000/0xc0f560bd53f8e5d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8e56 expref: 10 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.812120:0:5767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891382146000, rc 0) 00000100:00100000:2.0:1784756003.812145:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346889050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+10:6573:x1871452237207680:12345-0@lo:101: Request processed in 87us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756003.812150:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784756003.812280:0:6573:0:(client.c:2702:ptlrpc_set_wait()) set ffff891377e31a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784756003.812294:0:6573:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891374d65f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:6573:1871452237207680:0@lo:101: 00010000:00010000:3.0:1784756003.812306:0:6573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff89134151a800/0xc0f560bd53f8e56 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8e5d expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.812315:0:6573:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff89134151a800/0xc0f560bd53f8e56 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0f560bd53f8e5d expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784756003.812332:0:6573:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784756003.812629:0:6573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff89134151a800/0xc0f560bd53f8e56 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8e5d expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.812639:0:6573:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff89134151a800/0xc0f560bd53f8e56 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8e5d expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784756003.812647:0:6573:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1784756003.812714:0:6573:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784756003.812723:0:6573:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1784756003.812726:0:6573:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1784756003.812747:0:6573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff891342baf600/0xc0f560bd53f8e64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756003.812758:0:6573:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff891342baf600/0xc0f560bd53f8e64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756003.812765:0:6573:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff891342baf600/0xc0f560bd53f8e64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756003.812779:0:6573:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346760380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:6573:1871452237207936:0@lo:101: 00000100:00100000:0.0:1784756003.812808:0:6573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756003.812838:0:6573:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913517d0900 going to sleep for 11 seconds 00000100:00100000:3.0:1784756003.812972:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237207936 00000100:00100000:3.0:1784756003.812977:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237207936 00000100:00100000:3.0:1784756003.813011:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784756003.813019:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+10:6573:x1871452237207936:12345-0@lo:101: 00010000:00010000:3.0:1784756003.813047:0:5768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784756003.813056:0:5768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89134151a600/0xc0f560bd53f8e6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0f560bd53f8e64 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.813071:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89134151a600/0xc0f560bd53f8e6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0f560bd53f8e64 expref: 11 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.813080:0:5768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89134151a600/0xc0f560bd53f8e6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8e64 expref: 11 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.813088:0:5768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89134151a600, rc 0) 00000100:00100000:3.0:1784756003.813130:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+11:6573:x1871452237207936:12345-0@lo:101: Request processed in 112us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756003.813137:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784756003.813204:0:6573:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346760380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:6573:1871452237207936:0@lo:101: 00010000:00010000:0.0:1784756003.813214:0:6573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff891342baf600/0xc0f560bd53f8e64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8e6b expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756003.813239:0:6573:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff891342baf600/0xc0f560bd53f8e64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0f560bd53f8e6b expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756003.813330:0:6573:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346760380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:6573:1871452237208064:0@lo:501: 00000100:00100000:0.0:1784756003.813366:0:6573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756003.813394:0:6573:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913517d0900 going to sleep for 11 seconds 00000100:00100000:2.0:1784756003.813602:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237208064 00000100:00100000:2.0:1784756003.813607:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237208064 00000100:00100000:2.0:1784756003.813634:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784756003.813641:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+11:6573:x1871452237208064:12345-0@lo:501: 00000100:00100000:2.0:1784756003.813906:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+11:6573:x1871452237208064:12345-0@lo:501: Request processed in 265us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756003.813913:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784756003.814015:0:6573:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346760380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:6573:1871452237208064:0@lo:501: 00000100:00100000:0.0:1784756003.814061:0:6573:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346760380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:6573:1871452237208192:0@lo:503: 00000100:00100000:0.0:1784756003.814098:0:6573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756003.814116:0:6573:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913517d0900 going to sleep for 11 seconds 00000100:00100000:3.0:1784756003.814164:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237208192 00000100:00100000:3.0:1784756003.814169:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237208192 00000100:00100000:3.0:1784756003.814199:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784756003.814206:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+11:6573:x1871452237208192:12345-0@lo:503: 00000100:00100000:3.0:1784756003.814369:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+11:6573:x1871452237208192:12345-0@lo:503: Request processed in 162us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756003.814384:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784756003.814716:0:6573:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346760380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:6573:1871452237208192:0@lo:503: 00000040:00080000:0.0:1784756003.815008:0:6573:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784756003.815080:0:6573:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346760380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:6573:1871452237208320:0@lo:502: 00000100:00100000:0.0:1784756003.815121:0:6573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756003.815143:0:6573:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913517d0900 going to sleep for 11 seconds 00000100:00100000:2.0:1784756003.815210:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237208320 00000100:00100000:2.0:1784756003.815225:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237208320 00000100:00100000:2.0:1784756003.815262:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784756003.815270:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+11:6573:x1871452237208320:12345-0@lo:502: 00000100:00100000:2.0:1784756003.815462:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+11:6573:x1871452237208320:12345-0@lo:502: Request processed in 192us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756003.815476:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784756003.815734:0:6573:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346760380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:6573:1871452237208320:0@lo:502: 00000040:00080000:0.0:1784756003.815991:0:6573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1784756003.816055:0:6573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1784756003.816093:0:6573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1784756003.816139:0:6573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1784756003.816189:0:6573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1784756003.816298:0:6573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1784756003.816328:0:6573:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346760380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:6573:1871452237208448:0@lo:502: 00000100:00100000:0.0:1784756003.816529:0:6573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756003.816562:0:6573:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913517d0900 going to sleep for 11 seconds 00000100:00100000:3.0:1784756003.816662:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237208448 00000100:00100000:3.0:1784756003.816667:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237208448 00000100:00100000:3.0:1784756003.816698:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784756003.816705:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+11:6573:x1871452237208448:12345-0@lo:502: 00000100:00100000:3.0:1784756003.816851:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+11:6573:x1871452237208448:12345-0@lo:502: Request processed in 145us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756003.816858:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784756003.817045:0:6573:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346760380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:6573:1871452237208448:0@lo:502: 00000040:00080000:0.0:1784756003.817135:0:6573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1784756003.817146:0:6573:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1784756003.819848:0:6591:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784756003.819864:0:6591:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1784756003.819872:0:6591:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784756003.819874:0:6591:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1784756003.819881:0:6591:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784756003.819899:0:6591:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff891347b099c0) 00000020:00000080:2.0:1784756003.819930:0:6591:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1784756003.819938:0:6591:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1784756003.820036:0:6591:0:(tgt_mount.c:153:server_get_mount()) get mount ffff891342e9d800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1784756003.820047:0:6591:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1784756003.820057:0:6591:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc0f560bd53f8e79 00010000:00010000:2.0:1784756003.829252:0:6591:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1784756003.830951:0:6591:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1784756003.834216:0:6591:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1784756003.834654:0:6591:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1784756003.841311:0:6591:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1784756003.842053:0:6591:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1784756003.845316:0:6591:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1784756003.845329:0:6591:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784756003.845335:0:6591:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784756003.845338:0:6591:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1784756003.845341:0:6591:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784756003.845345:0:6591:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784756003.845347:0:6591:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784756003.845350:0:6591:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784756003.845352:0:6591:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1784756003.847708:0:6591:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784756003.847721:0:6591:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784756003.847724:0:6591:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1784756003.847729:0:6591:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1784756003.848052:0:6573:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1784756003.848079:0:6573:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1784756003.848103:0:6573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff891342baf600/0xc0f560bd53f8e64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8e6b expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756003.848117:0:6573:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff891342baf600/0xc0f560bd53f8e64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8e6b expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784756003.848126:0:6573:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff891342e9d800 from 1 10000000:01000000:0.0:1784756003.848128:0:6573:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784756003.848170:0:6573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff891342baf400/0xc0f560bd53f8e80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756003.848178:0:6573:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff891342baf400/0xc0f560bd53f8e80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756003.848191:0:6573:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff891342baf400/0xc0f560bd53f8e80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756003.848214:0:6573:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346760380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:6573:1871452237208576:0@lo:101: 00000100:00100000:0.0:1784756003.848285:0:6573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756003.848335:0:6573:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913517d0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784756003.848401:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237208576 00000100:00100000:3.0:1784756003.848407:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237208576 00000100:00100000:3.0:1784756003.848476:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784756003.848486:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+11:6573:x1871452237208576:12345-0@lo:101: 00010000:00010000:3.0:1784756003.848499:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784756003.848513:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89134151b200/0xc0f560bd53f8e87 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0f560bd53f8e80 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.848540:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89134151b200/0xc0f560bd53f8e87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0f560bd53f8e80 expref: 12 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.848549:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89134151b200/0xc0f560bd53f8e87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8e80 expref: 12 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.848557:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89134151b200, rc 0) 00000100:00100000:3.0:1784756003.848600:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+12:6573:x1871452237208576:12345-0@lo:101: Request processed in 116us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756003.848606:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784756003.849798:0:6573:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346760380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:6573:1871452237208576:0@lo:101: 00010000:00010000:0.0:1784756003.849820:0:6573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff891342baf400/0xc0f560bd53f8e80 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8e87 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756003.849831:0:6573:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff891342baf400/0xc0f560bd53f8e80 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0f560bd53f8e87 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756003.849950:0:6573:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346760380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:6573:1871452237208704:0@lo:501: 00000100:00100000:0.0:1784756003.849993:0:6573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756003.850060:0:6573:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913517d0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784756003.851607:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237208704 00000100:00100000:1.0:1784756003.851618:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237208704 00000100:00100000:1.0:1784756003.851717:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784756003.851729:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+12:6573:x1871452237208704:12345-0@lo:501: 00000100:00100000:1.0:1784756003.852035:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+12:6573:x1871452237208704:12345-0@lo:501: Request processed in 300us (2032us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756003.852043:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784756003.852183:0:6573:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346760380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:6573:1871452237208704:0@lo:501: 00000100:00100000:0.0:1784756003.852227:0:6573:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346760380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:6573:1871452237208832:0@lo:503: 00000100:00100000:0.0:1784756003.852268:0:6573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756003.852371:0:6573:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913517d0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784756003.852541:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237208832 00000100:00100000:3.0:1784756003.852547:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237208832 00000100:00100000:3.0:1784756003.852573:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784756003.852579:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+12:6573:x1871452237208832:12345-0@lo:503: 00000100:00100000:3.0:1784756003.852851:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+12:6573:x1871452237208832:12345-0@lo:503: Request processed in 271us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756003.852858:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784756003.852944:0:6573:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346760380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:6573:1871452237208832:0@lo:503: 00000040:00080000:0.0:1784756003.853244:0:6573:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784756003.853305:0:6573:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346760380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:6573:1871452237208960:0@lo:502: 00000100:00100000:0.0:1784756003.853338:0:6573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756003.853363:0:6573:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913517d0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784756003.853446:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237208960 00000100:00100000:3.0:1784756003.853452:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237208960 00000100:00100000:3.0:1784756003.853473:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784756003.853479:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+12:6573:x1871452237208960:12345-0@lo:502: 00000100:00100000:3.0:1784756003.853637:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+12:6573:x1871452237208960:12345-0@lo:502: Request processed in 156us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756003.853644:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784756003.853726:0:6573:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346760380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:6573:1871452237208960:0@lo:502: 00000040:00080000:0.0:1784756003.853952:0:6573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1784756003.853999:0:6573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1784756003.854021:0:6573:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346760380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:6573:1871452237209088:0@lo:502: 00000100:00100000:0.0:1784756003.854066:0:6573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756003.854098:0:6573:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913517d0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784756003.854212:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237209088 00000100:00100000:3.0:1784756003.854217:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237209088 00000100:00100000:3.0:1784756003.854238:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784756003.854244:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+12:6573:x1871452237209088:12345-0@lo:502: 00000100:00100000:3.0:1784756003.854366:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+12:6573:x1871452237209088:12345-0@lo:502: Request processed in 122us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756003.854380:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784756003.854478:0:6573:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346760380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:6573:1871452237209088:0@lo:502: 00000040:00080000:0.0:1784756003.854556:0:6573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1784756003.854567:0:6573:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1784756003.855017:0:6595:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784756003.855039:0:6595:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784756003.855042:0:6595:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1784756003.855051:0:6595:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff891342e9d800 00000020:00000080:3.0:1784756003.855054:0:6595:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784756003.855076:0:6595:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784756003.855080:0:6595:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784756003.855081:0:6595:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1784756003.855085:0:6595:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1784756003.857262:0:6573:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1784756003.857297:0:6573:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784756003.857356:0:6573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff891342baf400/0xc0f560bd53f8e80 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8e87 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756003.857389:0:6573:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff891342baf400/0xc0f560bd53f8e80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8e87 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784756003.858636:0:6573:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1784756003.858643:0:6573:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff891342e9d800 10000000:01000000:0.0:1784756003.858647:0:6573:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff891342e9d800 10000000:01000000:0.0:1784756003.858652:0:6573:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784756003.858660:0:6573:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff891342e9d800 from 1 10000000:01000000:0.0:1784756003.858663:0:6573:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784756003.858702:0:6573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff891342bae600/0xc0f560bd53f8e8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756003.858713:0:6573:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff891342bae600/0xc0f560bd53f8e8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756003.858724:0:6573:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff891342bae600/0xc0f560bd53f8e8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756003.858748:0:6573:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346760380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:6573:1871452237209216:0@lo:101: 00000100:00100000:0.0:1784756003.858818:0:6573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756003.858863:0:6573:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913517d0540 going to sleep for 11 seconds 00000100:00100000:2.0:1784756003.862646:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237209216 00000100:00100000:2.0:1784756003.862661:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237209216 00000100:00100000:2.0:1784756003.862737:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784756003.862750:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+12:6573:x1871452237209216:12345-0@lo:101: 00010000:00010000:2.0:1784756003.862768:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756003.862801:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891382147600/0xc0f560bd53f8e95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0f560bd53f8e8e expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.862832:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891382147600/0xc0f560bd53f8e95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0f560bd53f8e8e expref: 13 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.862843:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891382147600/0xc0f560bd53f8e95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8e8e expref: 13 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.862852:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891382147600, rc 0) 00000100:00100000:2.0:1784756003.862938:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+13:6573:x1871452237209216:12345-0@lo:101: Request processed in 191us (4119us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756003.862946:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784756003.863048:0:6573:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346760380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:6573:1871452237209216:0@lo:101: 00010000:00010000:0.0:1784756003.863069:0:6573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff891342bae600/0xc0f560bd53f8e8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8e95 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756003.863079:0:6573:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff891342bae600/0xc0f560bd53f8e8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0f560bd53f8e95 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756003.863206:0:6573:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346760380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:6573:1871452237209344:0@lo:501: 00000100:00100000:0.0:1784756003.863240:0:6573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756003.863279:0:6573:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913517d0540 going to sleep for 11 seconds 00000100:00100000:1.0:1784756003.863331:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237209344 00000100:00100000:1.0:1784756003.863336:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237209344 00000100:00100000:1.0:1784756003.863372:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784756003.863473:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+13:6573:x1871452237209344:12345-0@lo:501: 00000100:00100000:1.0:1784756003.863709:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+13:6573:x1871452237209344:12345-0@lo:501: Request processed in 241us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756003.863716:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784756003.863798:0:6573:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346760380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:6573:1871452237209344:0@lo:501: 00000100:00100000:0.0:1784756003.863828:0:6573:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346760380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:6573:1871452237209472:0@lo:503: 00000100:00100000:0.0:1784756003.863863:0:6573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756003.863887:0:6573:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913517d0540 going to sleep for 11 seconds 00000100:00100000:2.0:1784756003.863947:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237209472 00000100:00100000:2.0:1784756003.863952:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237209472 00000100:00100000:2.0:1784756003.863982:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784756003.863989:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+13:6573:x1871452237209472:12345-0@lo:503: 00000100:00100000:2.0:1784756003.864148:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+13:6573:x1871452237209472:12345-0@lo:503: Request processed in 158us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756003.864155:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784756003.864361:0:6573:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346760380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:6573:1871452237209472:0@lo:503: 00000040:00080000:0.0:1784756003.864737:0:6573:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784756003.864801:0:6573:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346760380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:6573:1871452237209600:0@lo:502: 00000100:00100000:0.0:1784756003.864837:0:6573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756003.864856:0:6573:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913517d0540 going to sleep for 11 seconds 00000100:00100000:1.0:1784756003.865461:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237209600 00000100:00100000:1.0:1784756003.865467:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237209600 00000100:00100000:1.0:1784756003.865504:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784756003.865511:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+13:6573:x1871452237209600:12345-0@lo:502: 00000100:00100000:1.0:1784756003.865689:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+13:6573:x1871452237209600:12345-0@lo:502: Request processed in 178us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756003.865697:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784756003.866356:0:6573:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346760380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:6573:1871452237209600:0@lo:502: 00000040:00080000:0.0:1784756003.866671:0:6573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1784756003.866722:0:6573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1784756003.866749:0:6573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1784756003.866784:0:6573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1784756003.866811:0:6573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1784756003.866847:0:6573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1784756003.866874:0:6573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1784756003.866905:0:6573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1784756003.866965:0:6573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1784756003.867002:0:6573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1784756003.867047:0:6573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1784756003.867095:0:6573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1784756003.867130:0:6573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1784756003.867176:0:6573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1784756003.867224:0:6573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1784756003.867256:0:6573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1784756003.867282:0:6573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1784756003.867317:0:6573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1784756003.867344:0:6573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1784756003.867370:0:6573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1784756003.867451:0:6573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1784756003.867486:0:6573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1784756003.867512:0:6573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1784756003.867549:0:6573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1784756003.867589:0:6573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1784756003.867616:0:6573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1784756003.867653:0:6573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1784756003.867680:0:6573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1784756003.867717:0:6573:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346760380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:6573:1871452237209728:0@lo:502: 00000100:00100000:0.0:1784756003.867778:0:6573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756003.867822:0:6573:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913517d0540 going to sleep for 11 seconds 00000100:00100000:1.0:1784756003.868092:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237209728 00000100:00100000:1.0:1784756003.868099:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237209728 00000100:00100000:1.0:1784756003.868152:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784756003.868161:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+13:6573:x1871452237209728:12345-0@lo:502: 00000100:00100000:1.0:1784756003.868355:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+13:6573:x1871452237209728:12345-0@lo:502: Request processed in 195us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756003.868363:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784756003.868924:0:6573:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346760380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:6573:1871452237209728:0@lo:502: 00000040:00080000:0.0:1784756003.869022:0:6573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1784756003.869048:0:6573:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1784756003.871369:0:6596:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1784756003.871400:0:6596:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff891346953380) 00000020:00000080:3.0:1784756003.871463:0:6596:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1784756003.871636:0:6596:0:(tgt_mount.c:153:server_get_mount()) get mount ffff891342e9d800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1784756003.871641:0:6596:0:(tgt_mount.c:187:server_put_mount()) put mount ffff891342e9d800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1784756003.871644:0:6596:0:(obd_mount.c:710:lustre_put_lsi()) put ffff891342e9d800 3 00010000:00080000:3.0:1784756003.871677:0:6596:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89136f57e000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.141@tcp at head 00010000:00010000:3.0:1784756003.878334:0:6596:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1784756003.880732:0:6596:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1784756003.880776:0:6596:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784756003.880794:0:6596:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc0f560bd53f8ea3 00000100:00080000:3.0:1784756003.880806:0:6596:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784756003.880812:0:6596:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89136f57e000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1784756003.880849:0:6596:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff891374d65f80 x1871452237209856/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784756003.880913:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891374d65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3289:1871452237209856:0@lo:38: 00000100:00100000:2.0:1784756003.880992:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784756003.881151:0:6596:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1784756003.881343:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237209856 00000100:00100000:0.0:1784756003.881352:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237209856 00000100:00100000:0.0:1784756003.881401:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784756003.881410:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346879880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3289:x1871452237209856:12345-0@lo:38: 00010000:00080000:0.0:1784756003.881457:0:5776:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 121 last 0 00000020:00000080:0.0:1784756003.881490:0:5776:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc0f560bd53f8eaa 00000004:00100000:0.0:1784756003.881505:0:5776:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784756003.881537:0:5776:0:(import.c:65:import_set_state_nolock()) ffff89136f872000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784756003.884284:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784756003.884314:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3291:1871452237209984:0@lo:400: 00000100:00100000:3.0:1784756003.884407:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756003.884486:0:5774:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1784756003.884496:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1784756003.884672:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237209984 00000100:00100000:3.0:1784756003.884680:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237209984 00000100:00100000:3.0:1784756003.884735:0:5774:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1784756003.884745:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784756003.884754:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891374d65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1871452237209984:12345-0@lo:400: 00000100:00100000:3.0:1784756003.884812:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891374d65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1871452237209984:12345-0@lo:400: Request processed in 58us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756003.884819:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1784756003.884861:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff891375a81500 x1871452237209984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784756019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756003.884877:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3291:1871452237209984:0@lo:400: 00000040:00080000:3.0:1784756003.886812:0:6596:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:0.0:1784756003.887122:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346879880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1871452237209856:12345-0@lo:38: Request processed in 5703us (6121us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756003.887138:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:0.0:1784756003.887201:0:6573:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1784756003.887230:0:6573:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784756003.887257:0:6573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff891342bae600/0xc0f560bd53f8e8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8e95 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756003.887268:0:6573:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff891342bae600/0xc0f560bd53f8e8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8e95 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784756003.887317:0:6573:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784756003.887320:0:6573:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784756003.887321:0:6573:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784756003.887322:0:6573:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784756003.887323:0:6573:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784756003.887324:0:6573:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784756003.887326:0:6573:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784756003.887327:0:6573:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784756003.887329:0:6573:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784756003.887331:0:6573:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784756003.887332:0:6573:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784756003.887336:0:6573:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1784756003.887338:0:6573:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784756003.887339:0:6573:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784756003.887340:0:6573:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784756003.887341:0:6573:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784756003.887342:0:6573:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784756003.887343:0:6573:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784756003.887344:0:6573:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784756003.887345:0:6573:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784756003.887346:0:6573:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784756003.887347:0:6573:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784756003.887348:0:6573:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784756003.887373:0:6573:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1784756003.887398:0:6573:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346760380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:6573:1871452237210112:0@lo:253: 00000100:00100000:0.0:1784756003.887491:0:6573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756003.887524:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237210112 00000100:00100000:0.0:1784756003.887531:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237210112 00000100:00100000:0.0:1784756003.887568:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784756003.887575:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+13:6573:x1871452237210112:12345-0@lo:253: 20000000:01000000:0.0:1784756003.887612:0:5769:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1784756003.887625:0:5769:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1784756003.889122:0:6573:0:(client.c:2702:ptlrpc_set_wait()) set ffff89138199ccc0 going to sleep for 11 seconds 00010000:00080000:2.0:1784756003.890775:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff891374d65f80 x1871452237209856/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784756013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756003.890788:0:3289:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784756003.890798:0:3289:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1784756003.890806:0:3289:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1784756003.890812:0:3289:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1784756003.890826:0:3289:0:(import.c:65:import_set_state_nolock()) ffff89136f57e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784756003.890832:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891374d65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3289:1871452237209856:0@lo:38: 20000000:01000000:0.0:1784756003.931848:0:5769:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784756003.931869:0:5769:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1784756003.931924:0:5790:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784756003.931929:0:5790:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784756003.931950:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff891382147e00/0xc0f560bd53f8eb1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.931970:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891342bafa00/0xc0f560bd53f8e10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8e09 expref: 13 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.931980:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff891382147e00/0xc0f560bd53f8eb1 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.932033:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891342bafa00/0xc0f560bd53f8e10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0f560bd53f8e09 expref: 13 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.932049:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff891342bafa00/0xc0f560bd53f8e10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0f560bd53f8e09 expref: 13 pid: 5767 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756003.932067:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89134687aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5790:1871452237210240:0@lo:104: 00000100:00100000:2.0:1784756003.932136:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756003.932196:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913589146c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784756003.932387:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237210240 00000100:00100000:0.0:1784756003.932395:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237210240 00000100:00100000:0.0:1784756003.932490:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784756003.932500:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346878380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3a5739ad-a70a-4582-8756-59cdd498af45+3:5790:x1871452237210240:12345-0@lo:104: 00010000:00010000:0.0:1784756003.932514:0:5757:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8913429e4000/0xc0f560bd53f8e09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f8e10 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756003.932569:0:5757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784756003.932575:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346878380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3a5739ad-a70a-4582-8756-59cdd498af45+3:5790:x1871452237210240:12345-0@lo:104: Request processed in 78us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756003.932582:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1784756003.932618:0:5763:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784756003.932624:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8913429e4000/0xc0f560bd53f8e09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f8e10 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756003.932632:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8913429e4000 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:0.0:1784756003.932637:0:5763:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8913429e4000/0xc0f560bd53f8e09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0f560bd53f8e10 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756003.932665:0:5763:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8913429e4000/0xc0f560bd53f8e09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0f560bd53f8e10 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784756003.932674:0:5763:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8913429e4000/0xc0f560bd53f8e09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0f560bd53f8e10 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784756003.932679:0:5763:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784756003.932705:0:5763:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8913429e4000/0xc0f560bd53f8e09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8e10 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756003.932712:0:5763:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784756003.932727:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8913429e4000/0xc0f560bd53f8e09 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8e10 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756003.932735:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8913429e4000/0xc0f560bd53f8e09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8e10 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756003.932751:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756003.932753:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756003.932755:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756003.932763:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784756003.932774:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346761500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a5739ad-a70a-4582-8756-59cdd498af45:3290:1871452237210368:0@lo:103: 00000100:00100000:0.0:1784756003.932805:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756003.932995:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89134687aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5790:1871452237210240:0@lo:104: 00010000:00010000:1.0:1784756003.933019:0:5790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff891382147e00/0xc0f560bd53f8eb1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756003.933119:0:5759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237210368 00000100:00100000:3.0:1784756003.933124:0:5759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237210368 00010000:00010000:3.0:1784756003.933145:0:5759:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891342bafa00/0xc0f560bd53f8e10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f8e09 expref: 14 pid: 5767 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756003.933173:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784756003.933188:0:5759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346943050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a5739ad-a70a-4582-8756-59cdd498af45+14:3290:x1871452237210368:12345-0@lo:103: 00010000:00010000:3.0:1784756003.933202:0:5759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784756003.933209:0:5759:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891342bafa00/0xc0f560bd53f8e10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f8e09 expref: 14 pid: 5767 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.933220:0:5759:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891342bafa00/0xc0f560bd53f8e10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0f560bd53f8e09 expref: 14 pid: 5767 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.933234:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891342bafa00/0xc0f560bd53f8e10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0f560bd53f8e09 expref: 14 pid: 5767 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.933251:0:5759:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff891382147e00/0xc0f560bd53f8eb1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.933259:0:5759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891382147e00/0xc0f560bd53f8eb1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784756003.933274:0:5759:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002478927s 00010000:00010000:3.0:1784756003.933278:0:5759:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff891382147e00/0xc0f560bd53f8eb1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.933285:0:5759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff891382147e00/0xc0f560bd53f8eb1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.933293:0:5759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff891382147e00/0xc0f560bd53f8eb1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.933300:0:5759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff891382147e00/0xc0f560bd53f8eb1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.933305:0:5759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891382147e00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:3.0:1784756003.933309:0:5759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff891382147e00/0xc0f560bd53f8eb1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.933323:0:5759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff891382147e00/0xc0f560bd53f8eb1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.933343:0:5759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff891382147e00/0xc0f560bd53f8eb1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.933352:0:5759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784756003.933535:0:5759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346943050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a5739ad-a70a-4582-8756-59cdd498af45+13:3290:x1871452237210368:12345-0@lo:103: Request processed in 347us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756003.933543:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784756003.933599:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346761500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a5739ad-a70a-4582-8756-59cdd498af45:3290:1871452237210368:0@lo:103: 00010000:00010000:1.0:1784756003.933961:0:5790:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff891382147e00/0xc0f560bd53f8eb1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756003.933971:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff891382147e00/0xc0f560bd53f8eb1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756003.933979:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891382147e00/0xc0f560bd53f8eb1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756003.953174:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+12:6573:x1871452237210112:12345-0@lo:253: Request processed in 65586us (65671us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756003.953191:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784756003.953550:0:6573:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346760380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:6573:1871452237210112:0@lo:253: 10000000:01000000:0.0:1784756003.953569:0:6573:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1784756003.953572:0:6573:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784756003.953574:0:6573:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784756003.953576:0:6573:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784756003.953577:0:6573:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784756003.953598:0:6573:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784756003.953600:0:6573:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784756003.953602:0:6573:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784756003.953603:0:6573:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784756003.953605:0:6573:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784756003.953607:0:6573:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784756003.953609:0:6573:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1784756003.953630:0:6573:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1784756003.965003:0:6573:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1784756003.965205:0:6573:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1784756003.965900:0:6573:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1784756003.966161:0:6573:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1784756003.966364:0:6573:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1784756003.966644:0:6573:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1784756003.970808:0:6573:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1784756004.208883:0:6573:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1784756004.208890:0:6573:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1784756004.208929:0:6573:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1784756004.208984:0:6573:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.141@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1784756004.209000:0:6573:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1784756004.209019:0:6573:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1784756004.224481:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756005.237990:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784756005.619525:0:5772:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784756005.619534:0:5772:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8913516af000 from 21 10000000:01000000:3.0:1784756005.619539:0:5772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784756005.619584:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff89134151aa00/0xc0f560bd53f8eb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756005.619596:0:5772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff89134151aa00/0xc0f560bd53f8eb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756005.619607:0:5772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff89134151aa00/0xc0f560bd53f8eb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756005.619658:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891374d65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237210496:0@lo:101: 00000100:00100000:3.0:1784756005.619724:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756005.619880:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff891347c0cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1784756005.620130:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237210496 00000100:00100000:2.0:1784756005.620138:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237210496 00000100:00100000:2.0:1784756005.620189:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1784756005.620198:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+12:5772:x1871452237210496:12345-0@lo:101: 00010000:00010000:2.0:1784756005.620211:0:5768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756005.620227:0:5768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891382146600/0xc0f560bd53f8ebf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0f560bd53f8eb8 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756005.620251:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891382146600/0xc0f560bd53f8ebf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0f560bd53f8eb8 expref: 13 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756005.620263:0:5768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891382146600/0xc0f560bd53f8ebf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8eb8 expref: 13 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756005.620272:0:5768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891382146600, rc 0) 00000100:00100000:2.0:1784756005.620348:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+13:5772:x1871452237210496:12345-0@lo:101: Request processed in 151us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756005.620355:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784756005.620634:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891374d65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237210496:0@lo:101: 00010000:00010000:3.0:1784756005.620659:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff89134151aa00/0xc0f560bd53f8eb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8ebf expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756005.620670:0:5772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff89134151aa00/0xc0f560bd53f8eb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0f560bd53f8ebf expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756005.620727:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891374d65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237210624:0@lo:501: 00000100:00100000:3.0:1784756005.620755:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756005.621545:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff891347c0cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1784756005.621675:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237210624 00000100:00100000:0.0:1784756005.621681:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237210624 00000100:00100000:1.0:1784756005.621841:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784756005.621851:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+13:5772:x1871452237210624:12345-0@lo:501: 00000100:00100000:3.0:1784756005.622548:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891374d65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237210624:0@lo:501: 00000100:00100000:3.0:1784756005.622594:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891374d65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237210752:0@lo:503: 00000100:00100000:3.0:1784756005.623024:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756005.623060:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff891347c0cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1784756005.623287:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237210752 00000100:00100000:0.0:1784756005.623293:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237210752 00000100:00100000:0.0:1784756005.623441:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784756005.623450:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+14:5772:x1871452237210752:12345-0@lo:503: 00000100:00100000:2.0:1784756005.624025:0:5769:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:0.0:1784756005.624098:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+14:5772:x1871452237210752:12345-0@lo:503: Request processed in 648us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756005.624114:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784756005.624326:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+13:5772:x1871452237210624:12345-0@lo:501: Request processed in 2474us (3567us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756005.624333:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784756005.624772:0:5769:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:3.0:1784756005.627044:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891374d65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237210752:0@lo:503: 00000100:00100000:1.0:1784756005.627735:0:6670:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a82d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:6670:1871452237210880:0@lo:502: 00000100:00100000:1.0:1784756005.627830:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756005.627873:0:6670:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913754ee300 going to sleep for 11 seconds 00000100:00100000:0.0:1784756005.628057:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237210880 00000100:00100000:0.0:1784756005.628064:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237210880 00000100:00100000:0.0:1784756005.628130:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784756005.628141:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+13:6670:x1871452237210880:12345-0@lo:502: 00000100:00100000:0.0:1784756005.628756:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+13:6670:x1871452237210880:12345-0@lo:502: Request processed in 615us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756005.628775:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784756005.629026:0:6670:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a82d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:6670:1871452237210880:0@lo:502: 00000100:00100000:3.0:1784756005.629090:0:6670:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891374d65880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:6670:1871452237211008:0@lo:502: 00000100:00100000:3.0:1784756005.629145:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756005.629185:0:6670:0:(client.c:2702:ptlrpc_set_wait()) set ffff891347c0cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1784756005.629358:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237211008 00000100:00100000:0.0:1784756005.629449:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237211008 00000100:00100000:0.0:1784756005.629490:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784756005.629498:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+13:6670:x1871452237211008:12345-0@lo:502: 00000100:00100000:0.0:1784756005.629726:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+13:6670:x1871452237211008:12345-0@lo:502: Request processed in 228us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756005.629741:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784756005.629949:0:6670:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891374d65880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:6670:1871452237211008:0@lo:502: 00000040:00080000:3.0:1784756005.629980:0:6670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1784756005.630329:0:5772:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1784756005.630347:0:5772:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784756005.630358:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff89134151aa00/0xc0f560bd53f8eb8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8ebf expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756005.630550:0:5772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff89134151aa00/0xc0f560bd53f8eb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8ebf expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784756005.630559:0:5772:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784756005.630562:0:5772:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8913516af000 from 4 10000000:01000000:2.0:1784756005.630572:0:5772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784756005.630600:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff891382147a00/0xc0f560bd53f8ec6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756005.630609:0:5772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff891382147a00/0xc0f560bd53f8ec6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756005.630619:0:5772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff891382147a00/0xc0f560bd53f8ec6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756005.630637:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89134687b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237211136:0@lo:101: 00000100:00100000:2.0:1784756005.630748:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756005.630884:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff89136f855540 going to sleep for 11 seconds 00000100:00100000:0.0:1784756005.630926:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237211136 00000100:00100000:0.0:1784756005.630932:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237211136 00000100:00100000:0.0:1784756005.631002:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784756005.631021:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+13:5772:x1871452237211136:12345-0@lo:101: 00010000:00010000:0.0:1784756005.631034:0:5768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756005.631054:0:5768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891342baea00/0xc0f560bd53f8ecd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0f560bd53f8ec6 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756005.631082:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891342baea00/0xc0f560bd53f8ecd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0f560bd53f8ec6 expref: 14 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756005.631094:0:5768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891342baea00/0xc0f560bd53f8ecd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8ec6 expref: 14 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756005.631103:0:5768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891342baea00, rc 0) 00000100:00100000:0.0:1784756005.631287:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+14:5772:x1871452237211136:12345-0@lo:101: Request processed in 276us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756005.631294:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1784756005.631374:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89134687b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237211136:0@lo:101: 00010000:00010000:2.0:1784756005.631388:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff891382147a00/0xc0f560bd53f8ec6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8ecd expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756005.631397:0:5772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff891382147a00/0xc0f560bd53f8ec6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0f560bd53f8ecd expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756005.631474:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89134687b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237211264:0@lo:256: 00000100:00100000:2.0:1784756005.631505:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756005.631962:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff89136f855540 going to sleep for 11 seconds 00000100:00100000:1.0:1784756005.632241:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237211264 00000100:00100000:1.0:1784756005.632248:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237211264 00000100:00100000:1.0:1784756005.632293:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784756005.632298:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913466b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+14:5772:x1871452237211264:12345-0@lo:256: 20000000:01000000:1.0:1784756005.632323:0:5769:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784756005.632342:0:5769:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784756005.632346:0:5769:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1784756005.632619:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913466b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+14:5772:x1871452237211264:12345-0@lo:256: Request processed in 320us (1113us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756005.632624:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784756005.632716:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89134687b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237211264:0@lo:256: 10000000:01000000:2.0:1784756005.632773:0:5772:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784756005.632781:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff891382147a00/0xc0f560bd53f8ec6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8ecd expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756005.632788:0:5772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff891382147a00/0xc0f560bd53f8ec6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8ecd expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784756005.632799:0:5772:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1784756005.632801:0:5772:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1784756005.632803:0:5772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1784756005.632825:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff891382147e00/0xc0f560bd53f8ed4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756005.632830:0:5772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff891382147e00/0xc0f560bd53f8ed4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756005.632836:0:5772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff891382147e00/0xc0f560bd53f8ed4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756005.632847:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89134687b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237211392:0@lo:101: 00000100:00100000:2.0:1784756005.632867:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756005.632883:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff89136f855540 going to sleep for 11 seconds 00000100:00100000:2.0:1784756005.632893:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237211392 00000100:00100000:2.0:1784756005.632895:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237211392 00000100:00100000:2.0:1784756005.632908:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784756005.632914:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913466bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+14:5772:x1871452237211392:12345-0@lo:101: 00010000:00010000:2.0:1784756005.632921:0:5767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756005.632934:0:5767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891382146400/0xc0f560bd53f8edb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0f560bd53f8ed4 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756005.632954:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891382146400/0xc0f560bd53f8edb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0f560bd53f8ed4 expref: 15 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756005.632965:0:5767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891382146400/0xc0f560bd53f8edb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8ed4 expref: 15 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756005.632981:0:5767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891382146400, rc 0) 00000100:00100000:2.0:1784756005.633001:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913466bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+15:5772:x1871452237211392:12345-0@lo:101: Request processed in 88us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756005.633005:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784756005.633047:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89134687b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237211392:0@lo:101: 00010000:00010000:2.0:1784756005.633058:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff891382147e00/0xc0f560bd53f8ed4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8edb expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756005.633066:0:5772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff891382147e00/0xc0f560bd53f8ed4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0f560bd53f8edb expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756005.633285:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89134687b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237211520:0@lo:501: 00000100:00100000:2.0:1784756005.633314:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756005.633335:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237211520 00000100:00100000:2.0:1784756005.633338:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff89136f855540 going to sleep for 11 seconds 00000100:00100000:3.0:1784756005.633340:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237211520 00000100:00100000:3.0:1784756005.633377:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1784756005.633385:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913466b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+15:5772:x1871452237211520:12345-0@lo:501: 00000100:00100000:3.0:1784756005.633670:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913466b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+15:5772:x1871452237211520:12345-0@lo:501: Request processed in 286us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756005.633677:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784756005.633736:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89134687b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237211520:0@lo:501: 00000100:00100000:2.0:1784756005.633776:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89134687b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237211648:0@lo:503: 00000100:00100000:2.0:1784756005.633866:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756005.633886:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff89136f855540 going to sleep for 11 seconds 00000100:00100000:0.0:1784756005.634099:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237211648 00000100:00100000:0.0:1784756005.634104:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237211648 00000100:00100000:0.0:1784756005.634264:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1784756005.634272:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913466ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+15:5772:x1871452237211648:12345-0@lo:503: 00000100:00100000:0.0:1784756005.634611:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913466ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+15:5772:x1871452237211648:12345-0@lo:503: Request processed in 339us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756005.634619:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784756005.634632:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89134687b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237211648:0@lo:503: 00000100:00100000:3.0:1784756005.635387:0:6671:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891374d65880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:6671:1871452237211776:0@lo:502: 00000100:00100000:3.0:1784756005.635453:0:6671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756005.635491:0:6671:0:(client.c:2702:ptlrpc_set_wait()) set ffff891347c0c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784756005.635537:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237211776 00000100:00100000:2.0:1784756005.635541:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237211776 00000100:00100000:2.0:1784756005.635568:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784756005.635574:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913466b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+15:6671:x1871452237211776:12345-0@lo:502: 00000100:00100000:2.0:1784756005.636577:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913466b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+15:6671:x1871452237211776:12345-0@lo:502: Request processed in 999us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756005.636585:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1784756005.636598:0:6671:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891374d65880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:6671:1871452237211776:0@lo:502: 00000020:01000000:3.0:1784756005.636625:0:6671:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784756005.636633:0:6671:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1784756005.636698:0:6671:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784756005.636701:0:6671:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1784756005.636712:0:6671:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784756005.636714:0:6671:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.141@tcp to nid 0x20000c0a8ca8d (192.168.202.141@tcp) 00000020:01000000:3.0:1784756005.636732:0:6671:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1784756005.636734:0:6671:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784756005.636754:0:6671:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff891346718000) 00000020:00000080:3.0:1784756005.636846:0:6671:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1784756005.636853:0:6671:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1784756005.636911:0:6671:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1784756005.636917:0:6671:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:3.0:1784756005.636924:0:6671:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc0f560bd53f8ee9 00010000:00080000:3.0:1784756005.636956:0:6671:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89136f57f800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.141@tcp at head 00010000:00010000:3.0:1784756005.637284:0:6671:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1784756005.692292:0:6671:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1784756005.692319:0:6671:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1784756005.696357:0:6671:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784756005.700884:0:6671:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784756005.700963:0:6671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1784756005.701048:0:6671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1784756005.708380:0:6673:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784756005.708388:0:6673:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1784756005.716100:0:6671:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784756005.716382:0:6671:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1784756005.716465:0:6671:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1784756005.716492:0:6671:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc0f560bd53f8ef0 00000100:00080000:1.0:1784756005.716505:0:6671:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784756005.716511:0:6671:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89136f57f800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1784756005.716550:0:6671:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff891375a81f80 x1871452237211904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784756005.716582:0:6671:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1784756005.717004:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3289:1871452237211904:0@lo:8: 00000100:00100000:2.0:1784756005.717124:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756005.717484:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237211904 00000100:00100000:0.0:1784756005.717493:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237211904 00000100:00100000:0.0:1784756005.717546:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784756005.717554:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3289:x1871452237211904:12345-0@lo:8: 00010000:00080000:0.0:1784756005.717583:0:6575:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 123 last 0 00000020:00000080:0.0:1784756005.717608:0:6575:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc0f560bd53f8ef7 00002000:00100000:0.0:1784756005.717665:0:6575:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff89136f876000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136b7 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1784756005.717670:0:6575:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1784756005.717682:0:6575:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1784756005.717818:0:6575:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1784756005.717970:0:6575:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1784756005.717997:0:6575:0:(import.c:65:import_set_state_nolock()) ffff89136f875800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784756005.718300:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3289:x1871452237211904:12345-0@lo:8: Request processed in 743us (1173us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756005.719277:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784756005.719530:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891374d65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3292:1871452237212032:0@lo:400: 00000100:00100000:3.0:1784756005.719582:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756005.719619:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784756005.719625:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891374d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3292:1871452237212160:0@lo:400: 00000100:00100000:3.0:1784756005.719652:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1784756005.719749:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891375a81f80 x1871452237211904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784756015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756005.719761:0:3289:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784756005.719771:0:3289:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1784756005.719780:0:3289:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784756005.719786:0:3289:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1784756005.719789:0:3289:0:(import.c:65:import_set_state_nolock()) ffff89136f57f800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784756005.719804:0:3289:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784756005.719811:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3289:1871452237211904:0@lo:8: 00000020:01000000:1.0:1784756005.720480:0:6671:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:3.0:1784756005.721144:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237212032 00000100:00100000:3.0:1784756005.721153:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237212032 00000100:00100000:3.0:1784756005.721214:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237212160 00000100:00100000:3.0:1784756005.721218:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237212160 00000100:00100000:3.0:1784756005.721256:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784756005.721266:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891374d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1871452237212032:12345-0@lo:400: 00000100:00100000:3.0:1784756005.721346:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891374d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1871452237212032:12345-0@lo:400: Request processed in 82us (1764us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756005.721354:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784756005.721369:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784756005.721375:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891374d66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1871452237212160:12345-0@lo:400: 00000100:00100000:3.0:1784756005.721405:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891374d66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1871452237212160:12345-0@lo:400: Request processed in 31us (1752us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756005.721412:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1784756005.721493:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891374d67100 x1871452237212160/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784756021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756005.721507:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891374d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3292:1871452237212160:0@lo:400: 00010000:00080000:3.0:1784756005.721519:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891374d65880 x1871452237212032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784756021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756005.721543:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891374d65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3292:1871452237212032:0@lo:400: 00000100:00080000:0.0:1784756005.722454:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:1.0:1784756005.722807:0:6671:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784756005.722812:0:6671:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1784756005.722820:0:6671:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784756005.722834:0:6671:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784756005.722835:0:6671:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:1.0:1784756005.722840:0:6671:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784756005.722842:0:6671:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1784756005.722884:0:6671:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a80e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:6671:1871452237212288:0@lo:502: 00000100:00100000:1.0:1784756005.722943:0:6671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756005.723034:0:6671:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913469c3e40 going to sleep for 11 seconds 00000004:00080000:1.0:1784756005.723054:0:6673:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1784756005.723369:0:6673:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 123399953023ns, next at 0ns, rc = 0 00000100:00100000:0.0:1784756005.724447:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237212288 00000100:00100000:0.0:1784756005.724457:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237212288 00000100:00100000:0.0:1784756005.724501:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1784756005.724510:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913466bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+15:6671:x1871452237212288:12345-0@lo:502: 00000100:00100000:1.0:1784756005.725808:0:6671:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a80e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:6671:1871452237212288:0@lo:502: 00000020:01000000:1.0:1784756005.725854:0:6671:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784756005.725861:0:6671:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784756005.725864:0:6671:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:1.0:1784756005.725869:0:6671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:0.0:1784756005.726033:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913466bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+15:6671:x1871452237212288:12345-0@lo:502: Request processed in 1521us (3086us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756005.726043:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000020:01000000:3.0:1784756005.730516:0:5772:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1784756005.730566:0:5772:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1784756005.730580:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff891382147e00/0xc0f560bd53f8ed4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8edb expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756005.730595:0:5772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff891382147e00/0xc0f560bd53f8ed4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8edb expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784756005.730605:0:5772:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1784756005.730608:0:5772:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff891347b0b380 from 1 10000000:01000000:3.0:1784756005.730611:0:5772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784756005.730660:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff89134151b400/0xc0f560bd53f8efe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756005.730668:0:5772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff89134151b400/0xc0f560bd53f8efe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756005.730689:0:5772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff89134151b400/0xc0f560bd53f8efe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756005.730717:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891374d65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237212416:0@lo:101: 00000100:00100000:3.0:1784756005.730797:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756005.730848:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913511530c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784756005.731067:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237212416 00000100:00100000:0.0:1784756005.731075:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237212416 00000100:00100000:0.0:1784756005.731129:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1784756005.731138:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913466b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+15:5772:x1871452237212416:12345-0@lo:101: 00010000:00010000:0.0:1784756005.731150:0:5767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756005.731163:0:5767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891342baf000/0xc0f560bd53f8f05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0f560bd53f8efe expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756005.731187:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891342baf000/0xc0f560bd53f8f05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0f560bd53f8efe expref: 16 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756005.731198:0:5767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891342baf000/0xc0f560bd53f8f05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8efe expref: 16 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756005.731206:0:5767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891342baf000, rc 0) 00000100:00100000:0.0:1784756005.731243:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913466b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+16:5772:x1871452237212416:12345-0@lo:101: Request processed in 107us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756005.731250:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784756005.732346:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891374d65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237212416:0@lo:101: 00010000:00010000:3.0:1784756005.732366:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff89134151b400/0xc0f560bd53f8efe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8f05 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756005.732389:0:5772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff89134151b400/0xc0f560bd53f8efe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0f560bd53f8f05 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756005.732475:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891374d65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237212544:0@lo:501: 00000100:00100000:3.0:1784756005.732519:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756005.732558:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913511530c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784756005.732619:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237212544 00000100:00100000:1.0:1784756005.732625:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237212544 00000100:00100000:1.0:1784756005.732822:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1784756005.732834:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347ad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+16:5772:x1871452237212544:12345-0@lo:501: 00000100:00100000:1.0:1784756005.733080:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347ad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+16:5772:x1871452237212544:12345-0@lo:501: Request processed in 250us (561us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784756005.733088:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1784756005.733160:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891374d65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237212544:0@lo:501: 10000000:01000000:3.0:1784756005.733186:0:5772:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1784756005.733194:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff89134151b400/0xc0f560bd53f8efe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8f05 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756005.733203:0:5772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff89134151b400/0xc0f560bd53f8efe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8f05 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784756005.799045:0:6674:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1784756005.799082:0:6674:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891374d67100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6674:1871452237212800:0@lo:7: 00000100:00100000:3.0:1784756005.799226:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756005.799278:0:6674:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913754ee300 going to sleep for 11 seconds 00000100:00100000:3.0:1784756005.799329:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891374d65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237212672:0@lo:13: 00000100:00100000:3.0:1784756005.799355:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756005.799618:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237212800 00000100:00100000:3.0:1784756005.799626:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237212800 00000100:00100000:3.0:1784756005.799688:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784756005.799698:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891374d65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6674:x1871452237212800:12345-0@lo:7: 00000100:00080000:2.0:1784756005.802109:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784756005.808844:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237212672 00000100:00100000:1.0:1784756005.808858:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237212672 00000100:00100000:1.0:1784756005.808925:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784756005.808936:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891374d64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3290:x1871452237212672:12345-0@lo:13: 00002000:00000024:1.0:1784756005.808976:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1784756005.809080:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891374d64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3290:x1871452237212672:12345-0@lo:13: Request processed in 145us (9722us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756005.809087:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1784756005.809494:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891374d65880 x1871452237212672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756021 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756005.809523:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891374d65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237212672:0@lo:13: 00002000:00080000:3.0:1784756005.819478:0:6578:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1784756005.819488:0:6578:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1784756005.819603:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891374d65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6674:x1871452237212800:12345-0@lo:7: Request processed in 19902us (20373us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756005.819616:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1784756005.819684:0:6674:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891374d67100 x1871452237212800/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784756021 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756005.819701:0:6674:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891374d67100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6674:1871452237212800:0@lo:7: 00000004:00080000:3.0:1784756005.819720:0:6674:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1784756005.819771:0:6674:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891374d67100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6674:1871452237212928:0@lo:5: 00000100:00100000:3.0:1784756005.819804:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756005.819849:0:6674:0:(client.c:2702:ptlrpc_set_wait()) set ffff891377e31b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784756005.819871:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237212928 00000100:00100000:3.0:1784756005.819877:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237212928 00000100:00100000:3.0:1784756005.819915:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784756005.819924:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891374d65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6674:x1871452237212928:12345-0@lo:5: 00002000:00080000:3.0:1784756005.819949:0:6576:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1784756005.819952:0:6576:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1784756005.828961:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891374d65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6674:x1871452237212928:12345-0@lo:5: Request processed in 9029us (9147us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1784756005.828976:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1784756005.835771:0:6674:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891374d67100 x1871452237212928/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784756021 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756005.835794:0:6674:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891374d67100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6674:1871452237212928:0@lo:5: 00000004:00080000:3.0:1784756005.835823:0:6674:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1784756005.835870:0:6674:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891374d65180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6674:1871452237213056:0@lo:700: 00000100:00100000:3.0:1784756005.836650:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756005.836706:0:6674:0:(client.c:2702:ptlrpc_set_wait()) set ffff891377e31b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784756005.837079:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237213056 00000100:00100000:0.0:1784756005.837088:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237213056 00000100:00100000:0.0:1784756005.837200:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784756005.837209:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891374d66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6674:x1871452237213056:12345-0@lo:700: 00000100:00100000:0.0:1784756005.837253:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346760380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6584:1871452237213184:0@lo:700: 00000100:00100000:0.0:1784756005.837313:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756005.837336:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff89136f8556c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784756005.837358:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237213184 00000100:00100000:0.0:1784756005.837437:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237213184 00000100:00100000:0.0:1784756005.837462:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784756005.837468:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6584:x1871452237213184:12345-0@lo:700: 00000004:00080000:3.0:1784756005.886886:0:5796:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:0.0:1784756005.942227:0:5781:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1784756005.957570:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6584:x1871452237213184:12345-0@lo:700: Request processed in 120089us (120254us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756005.957596:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1784756005.957605:0:6584:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891346760380 x1871452237213184/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1784756021 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756005.957619:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346760380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6584:1871452237213184:0@lo:700: 40000000:02000000:0.0:1784756005.957633:0:6584:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00100000:3.0:1784756006.066671:0:6601:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1784756006.066704:0:6601:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:1.0:1784756006.067079:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891374d66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6674:x1871452237213056:12345-0@lo:700: Request processed in 229867us (230435us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756006.067100:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1784756006.067195:0:6674:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891374d65180 x1871452237213056/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1784756021 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756006.067209:0:6674:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1784756006.067230:0:6674:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891374d65180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6674:1871452237213056:0@lo:700: 00000004:02000040:3.0:1784756006.140805:0:6674:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1784756006.147570:0:6674:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891374d65180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6674:1871452237213312:0@lo:5: 00000100:00100000:3.0:1784756006.148449:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756006.148502:0:6674:0:(client.c:2702:ptlrpc_set_wait()) set ffff891377e31240 going to sleep for 11 seconds 00000100:00100000:3.0:1784756006.148528:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237213312 00000100:00100000:3.0:1784756006.148535:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237213312 00000100:00100000:3.0:1784756006.148581:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784756006.148589:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891374d67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:6674:x1871452237213312:12345-0@lo:5: 00002000:00080000:3.0:1784756006.169887:0:6576:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1784756006.169907:0:6576:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1784756006.180997:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891374d67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6674:x1871452237213312:12345-0@lo:5: Request processed in 32399us (32629us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1784756006.181023:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1784756006.181227:0:6674:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891374d65180 x1871452237213312/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784756022 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756006.181242:0:6674:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891374d65180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6674:1871452237213312:0@lo:5: 00000004:00080000:2.0:1784756006.181254:0:6674:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1784756006.259828:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756007.284515:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756008.311501:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756009.333274:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756010.361873:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784756010.631706:0:6945:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1784756010.805220:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89134687b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237213824:0@lo:400: 00000100:00100000:1.0:1784756010.805300:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756010.805300:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89134687ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3a5739ad-a70a-4582-8756-59cdd498af45:3291:1871452237213440:0@lo:400: 00000100:00100000:0.0:1784756010.805347:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756010.805383:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237213440 00000100:00100000:0.0:1784756010.805390:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237213440 00000100:00100000:2.0:1784756010.805437:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237213824 00000100:00100000:2.0:1784756010.805441:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237213824 00000100:00100000:0.0:1784756010.805460:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784756010.805468:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347ad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+16:3291:x1871452237213440:12345-0@lo:400: 00000100:00100000:2.0:1784756010.805477:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784756010.805485:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3290:x1871452237213824:12345-0@lo:400: 00000100:00100000:2.0:1784756010.805518:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3290:x1871452237213824:12345-0@lo:400: Request processed in 35us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756010.805518:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347ad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+16:3291:x1871452237213440:12345-0@lo:400: Request processed in 50us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756010.805526:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784756010.805526:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:2.0:1784756010.805545:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784756010.805569:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89134687ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3a5739ad-a70a-4582-8756-59cdd498af45:3291:1871452237213440:0@lo:400: 00010000:00080000:2.0:1784756010.805570:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89134687b100 x1871452237213824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756010.805580:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89134687b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237213824:0@lo:400: 00000100:00100000:2.0:1784756010.806527:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3292:1871452237213568:0@lo:400: 00000100:00100000:2.0:1784756010.806573:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756010.806616:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784756010.806645:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346878e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3292:1871452237213696:0@lo:400: 00000100:00100000:2.0:1784756010.806684:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756010.806773:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237213568 00000100:00100000:1.0:1784756010.806779:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237213568 00000100:00100000:1.0:1784756010.806811:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237213696 00000100:00100000:1.0:1784756010.806813:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237213696 00000100:00100000:1.0:1784756010.806831:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784756010.806836:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134687b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1871452237213568:12345-0@lo:400: 00000100:00100000:1.0:1784756010.806869:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134687b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1871452237213568:12345-0@lo:400: Request processed in 33us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756010.806873:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784756010.806881:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784756010.806885:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1871452237213696:12345-0@lo:400: 00000100:00100000:1.0:1784756010.806899:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1871452237213696:12345-0@lo:400: Request processed in 14us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756010.806902:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1784756010.807027:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1784756010.807054:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891346878e00 x1871452237213696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784756026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756010.807065:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346878e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3292:1871452237213696:0@lo:400: 00010000:00080000:2.0:1784756010.807074:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891346879f80 x1871452237213568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784756026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756010.807082:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3292:1871452237213568:0@lo:400: 00000100:00100000:3.0:1784756011.315563:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784756011.315602:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891374d67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237213952:0@lo:13: 00000100:00100000:3.0:1784756011.315672:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756011.315798:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237213952 00000100:00100000:1.0:1784756011.315806:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237213952 00000100:00100000:1.0:1784756011.315852:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784756011.315861:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891374d65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3290:x1871452237213952:12345-0@lo:13: 00002000:00000024:1.0:1784756011.315910:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784756011.315982:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891374d65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3290:x1871452237213952:12345-0@lo:13: Request processed in 122us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756011.315990:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1784756011.316048:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891374d67b80 x1871452237213952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756027 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756011.316069:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891374d67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237213952:0@lo:13: 00010000:00010000:1.0:1784756011.379651:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784756011.403497:0:6601:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1784756012.403980:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756013.428614:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756014.453972:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756015.476805:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756015.924113:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891374d67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a5739ad-a70a-4582-8756-59cdd498af45:3292:1871452237214080:0@lo:400: 00000100:00100000:3.0:1784756015.924790:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756015.924923:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784756015.924932:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891374d67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3292:1871452237214208:0@lo:400: 00000100:00100000:3.0:1784756015.924968:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756015.925014:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375ee7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3290:1871452237214336:0@lo:400: 00000100:00100000:3.0:1784756015.925039:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756015.925060:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784756015.925065:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375ee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237214464:0@lo:400: 00000100:00100000:3.0:1784756015.925090:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756015.925125:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237214208 00000100:00100000:0.0:1784756015.925475:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237214080 00000100:00100000:0.0:1784756015.925481:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237214080 00000100:00100000:0.0:1784756015.925543:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784756015.925552:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347ad3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+16:3292:x1871452237214080:12345-0@lo:400: 00000100:00100000:0.0:1784756015.925948:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347ad3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+16:3292:x1871452237214080:12345-0@lo:400: Request processed in 395us (1157us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756015.925957:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784756015.926332:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237214208 00000100:00100000:3.0:1784756015.926377:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237214336 00000100:00100000:3.0:1784756015.926381:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237214336 00000100:00100000:3.0:1784756015.926410:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784756015.926436:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375ee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1871452237214208:12345-0@lo:400: 00000100:00100000:2.0:1784756015.926545:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784756015.926558:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1871452237214336:12345-0@lo:400: 00000100:00100000:2.0:1784756015.926675:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1871452237214336:12345-0@lo:400: Request processed in 54us (1566us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756015.926682:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784756015.927371:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237214464 00000100:00100000:3.0:1784756015.927378:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237214464 00000100:00100000:3.0:1784756015.927438:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784756015.927672:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3290:x1871452237214464:12345-0@lo:400: 00000100:00100000:3.0:1784756015.927734:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3290:x1871452237214464:12345-0@lo:400: Request processed in 289us (2643us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756015.927741:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1784756015.927757:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784756015.927772:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1784756015.927804:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891375ee7800 x1871452237214464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756015.927816:0:3290:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1784756015.928706:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375ee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237214464:0@lo:400: 00010000:00080000:3.0:1784756015.928729:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891375ee7b80 x1871452237214336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784756031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756015.928740:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375ee7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3290:1871452237214336:0@lo:400: 00000100:00100000:3.0:1784756015.928773:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891374d67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a5739ad-a70a-4582-8756-59cdd498af45:3292:1871452237214080:0@lo:400: 00000100:00100000:3.0:1784756015.929773:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375ee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1871452237214208:12345-0@lo:400: Request processed in 3332us (4798us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756015.929785:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1784756015.930204:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891374d67b80 x1871452237214208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784756031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756015.930306:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891374d67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3292:1871452237214208:0@lo:400: 00000100:00100000:2.0:1784756016.436717:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237214592:0@lo:13: 00000100:00100000:2.0:1784756016.436788:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756016.436897:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237214592 00000100:00100000:2.0:1784756016.436905:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237214592 00000100:00100000:2.0:1784756016.437094:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784756016.437106:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346878e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237214592:12345-0@lo:13: 00002000:00000024:2.0:1784756016.437146:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756016.437189:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346878e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237214592:12345-0@lo:13: Request processed in 85us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756016.437196:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1784756016.437238:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891346879f80 x1871452237214592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756032 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756016.437264:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237214592:0@lo:13: 00010000:00010000:3.0:1784756016.499713:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756017.523820:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756018.548964:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756019.571748:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756020.597888:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1784756020.772294:0:7458:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1784756020.772298:0:7458:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1784756020.772487:0:7458:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff89136f870000 00000020:01000004:2.0:1784756020.772606:0:7458:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1784756020.772622:0:7458:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1784756020.772718:0:7458:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff89134671cd40) 00000020:00000080:3.0:1784756020.772740:0:7458:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1784756020.801199:0:7458:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1784756020.801649:0:7458:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1784756020.841078:0:7458:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1784756020.851412:0:7458:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1784756020.851477:0:7458:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1784756020.851538:0:7458:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1784756020.851568:0:7458:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1784756020.851947:0:7458:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1784756020.851959:0:7458:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784756020.851971:0:7458:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc0f560bd53f8f13 00000020:01000004:2.0:1784756020.851980:0:7458:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1784756020.852003:0:7458:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.141@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1784756020.852006:0:7458:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.141@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1784756020.852012:0:7458:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1784756020.852034:0:7458:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1784756020.852039:0:7458:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.141@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1784756020.911688:0:7458:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 00000020:01000004:0.0:1784756020.911726:0:7458:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.141@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1784756020.911730:0:7458:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1784756020.911731:0:7458:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784756020.911733:0:7458:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784756020.911734:0:7458:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784756020.911735:0:7458:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784756020.911736:0:7458:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784756020.911737:0:7458:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784756020.911738:0:7458:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784756020.911740:0:7458:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784756020.911742:0:7458:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784756020.911743:0:7458:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784756020.911748:0:7458:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1784756020.911749:0:7458:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784756020.911751:0:7458:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784756020.911752:0:7458:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784756020.911753:0:7458:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784756020.911754:0:7458:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784756020.911755:0:7458:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784756020.911756:0:7458:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784756020.911757:0:7458:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784756020.911758:0:7458:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784756020.911759:0:7458:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784756020.911760:0:7458:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784756020.911795:0:7458:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1784756020.911814:0:7458:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346760380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:7458:1871452237214720:0@lo:253: 00000100:00100000:0.0:1784756020.919080:0:7458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756020.921338:0:7458:0:(client.c:2702:ptlrpc_set_wait()) set ffff89134924b540 going to sleep for 11 seconds 00000100:00100000:2.0:1784756020.929103:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237214720 00000100:00100000:2.0:1784756020.929410:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237214720 00000100:00100000:2.0:1784756020.929507:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1784756020.929517:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347ad1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+16:7458:x1871452237214720:12345-0@lo:253: 20000000:01000000:2.0:1784756020.929558:0:5767:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1784756020.929562:0:5767:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1784756020.929581:0:5767:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1784756020.929584:0:5767:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1784756020.936855:0:5767:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784756020.937334:0:5767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1784756020.937351:0:5767:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1784756020.937397:0:5767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1784756020.937407:0:5767:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1784756020.937684:0:5767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1784756020.937745:0:5767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1784756020.938631:0:5767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1784756020.938655:0:5767:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.141@tcp 20000000:01000000:0.0:1784756020.938658:0:5767:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.141@tcp (null) (null) (null) 00000040:00080000:0.0:1784756020.938696:0:5767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1784756020.938704:0:5767:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1784756020.938828:0:5767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1784756020.938839:0:5767:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.141@tcp (null) (null) 00000040:00080000:0.0:1784756020.938890:0:5767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1784756020.938900:0:5767:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1784756020.938933:0:5767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1784756020.938983:0:5767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1784756020.939918:0:5767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1784756020.939941:0:5767:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.141@tcp 20000000:01000000:0.0:1784756020.939944:0:5767:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.141@tcp (null) (null) (null) 00000040:00080000:0.0:1784756020.939978:0:5767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1784756020.939985:0:5767:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1784756020.940034:0:5767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1784756020.940043:0:5767:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.141@tcp (null) (null) 00000040:00080000:0.0:1784756020.940074:0:5767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1784756020.940082:0:5767:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1784756020.940140:0:5767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1784756020.940180:0:5767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1784756020.940196:0:5767:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1784756020.940198:0:5767:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1784756020.940205:0:5767:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1784756020.940206:0:5767:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1784756020.940208:0:5767:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1784756020.940220:0:5767:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1784756020.940348:0:5767:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1784756020.940389:0:5767:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1784756020.940392:0:5767:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1784756020.941398:0:7460:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1784756020.941575:0:7460:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1784756020.941613:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1784756020.942039:0:5767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1784756020.942093:0:5767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1784756020.942150:0:5767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1784756020.942163:0:5767:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1784756020.942165:0:5767:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1784756020.942900:0:7461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1784756020.943153:0:5767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1784756020.943196:0:5767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1784756020.943392:0:5767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1784756020.943406:0:5767:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1784756020.943408:0:5767:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1784756020.944892:0:7462:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1784756020.944963:0:7462:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1784756020.945032:0:7462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1784756020.945915:0:5767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1784756020.945962:0:5767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1784756020.946083:0:5767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1784756020.946100:0:5767:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1784756020.946102:0:5767:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1784756020.946947:0:7463:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1784756020.947069:0:7463:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1784756020.947129:0:7463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1784756020.947668:0:5767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1784756020.947714:0:5767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1784756020.947751:0:5767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 10000000:01000000:3.0:1784756020.947846:0:5767:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1784756020.947866:0:5767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89134151b000/0xc0f560bd53f8f1a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756020.947895:0:5767:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89134151a600/0xc0f560bd53f8e6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8e64 expref: 16 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756020.947904:0:5767:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891382147600/0xc0f560bd53f8e95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8e8e expref: 16 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756020.947910:0:5767:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891382146600/0xc0f560bd53f8ebf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8eb8 expref: 16 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756020.947916:0:5767:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891382146400/0xc0f560bd53f8edb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8ed4 expref: 16 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756020.947923:0:5767:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891342baf000/0xc0f560bd53f8f05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8efe expref: 16 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756020.947930:0:5767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89134151b000/0xc0f560bd53f8f1a lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756020.947990:0:5767:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891342baf000/0xc0f560bd53f8f05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0f560bd53f8efe expref: 16 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756020.948062:0:5767:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff891342baf000/0xc0f560bd53f8f05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0f560bd53f8efe expref: 16 pid: 5767 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756020.948081:0:5767:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375ee7b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5767:1871452237214848:0@lo:104: 00000100:00100000:3.0:1784756020.948156:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756020.948399:0:5758:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1784756020.948460:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237214848 00000100:00100000:2.0:1784756020.948468:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237214848 00000100:00100000:2.0:1784756020.948514:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784756020.948523:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891358591050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3a5739ad-a70a-4582-8756-59cdd498af45+3:5767:x1871452237214848:12345-0@lo:104: 00010000:00010000:2.0:1784756020.948537:0:5758:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff89134151b400/0xc0f560bd53f8efe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f8f05 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756020.948669:0:5767:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891382146400/0xc0f560bd53f8edb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0f560bd53f8ed4 expref: 16 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756020.948679:0:5767:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff891382146400/0xc0f560bd53f8edb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0f560bd53f8ed4 expref: 16 pid: 5767 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756020.948688:0:5767:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375ee7800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5767:1871452237214976:0@lo:104: 00000100:00100000:3.0:1784756020.948712:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784756020.948737:0:5767:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891382146600/0xc0f560bd53f8ebf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0f560bd53f8eb8 expref: 16 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756020.948744:0:5767:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff891382146600/0xc0f560bd53f8ebf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0f560bd53f8eb8 expref: 16 pid: 5768 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756020.948751:0:5767:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375ee7480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5767:1871452237215104:0@lo:104: 00000100:00100000:3.0:1784756020.948782:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784756020.948798:0:5767:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891382147600/0xc0f560bd53f8e95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0f560bd53f8e8e expref: 16 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756020.948805:0:5767:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff891382147600/0xc0f560bd53f8e95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0f560bd53f8e8e expref: 16 pid: 5769 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756020.948824:0:5767:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375ee6d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5767:1871452237215232:0@lo:104: 00000100:00100000:3.0:1784756020.948842:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784756020.948856:0:5767:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89134151a600/0xc0f560bd53f8e6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0f560bd53f8e64 expref: 16 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756020.948864:0:5767:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89134151a600/0xc0f560bd53f8e6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0f560bd53f8e64 expref: 16 pid: 5768 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756020.948883:0:5767:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375ee4e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5767:1871452237215360:0@lo:104: 00000100:00100000:3.0:1784756020.948900:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756020.948910:0:5767:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913584a4540 going to sleep for 11 seconds 00000100:00100000:3.0:1784756020.948928:0:5767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375ee7b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5767:1871452237214848:0@lo:104: 00010000:00010000:2.0:1784756020.949190:0:5758:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784756020.949198:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891358591050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3a5739ad-a70a-4582-8756-59cdd498af45+3:5767:x1871452237214848:12345-0@lo:104: Request processed in 676us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756020.949206:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784756020.949254:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237214976 00000100:00100000:2.0:1784756020.949259:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237214976 00000100:00100000:2.0:1784756020.949284:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237215104 00000100:00100000:2.0:1784756020.949287:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237215104 00000100:00100000:2.0:1784756020.949296:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237215232 00000100:00100000:2.0:1784756020.949298:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237215232 00000100:00100000:2.0:1784756020.949306:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237215360 00000100:00100000:2.0:1784756020.949308:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237215360 00000100:00100000:2.0:1784756020.949319:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784756020.949324:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375ee4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3a5739ad-a70a-4582-8756-59cdd498af45+6:5767:x1871452237214976:12345-0@lo:104: 00010000:00010000:2.0:1784756020.949333:0:5758:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff891382147e00/0xc0f560bd53f8ed4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f8edb expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756020.949441:0:5767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375ee7800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5767:1871452237214976:0@lo:104: 00010000:00010000:1.0:1784756020.949815:0:5763:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784756020.949823:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff89134151b400/0xc0f560bd53f8efe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f8f05 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756020.949830:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89134151b400 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:1.0:1784756020.949834:0:5763:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff89134151b400/0xc0f560bd53f8efe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0f560bd53f8f05 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756020.949842:0:5763:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff89134151b400/0xc0f560bd53f8efe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0f560bd53f8f05 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784756020.949849:0:5763:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff89134151b400/0xc0f560bd53f8efe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0f560bd53f8f05 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784756020.949854:0:5763:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784756020.949900:0:5763:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff89134151b400/0xc0f560bd53f8efe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8f05 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756020.949906:0:5763:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1784756020.949962:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3a5739ad-a70a-4582-8756-59cdd498af45:3293:1871452237215488:0@lo:103: 00000100:00100000:0.0:1784756020.950007:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784756020.950057:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff89134151b400/0xc0f560bd53f8efe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8f05 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756020.950065:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff89134151b400/0xc0f560bd53f8efe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8f05 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756020.950079:0:5763:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784756020.950083:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff891382147e00/0xc0f560bd53f8ed4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f8edb expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756020.950089:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891382147e00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:1.0:1784756020.950092:0:5763:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff891382147e00/0xc0f560bd53f8ed4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0f560bd53f8edb expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756020.950098:0:5763:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff891382147e00/0xc0f560bd53f8ed4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0f560bd53f8edb expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784756020.950104:0:5763:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff891382147e00/0xc0f560bd53f8ed4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0f560bd53f8edb expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784756020.950109:0:5763:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784756020.950124:0:5763:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff891382147e00/0xc0f560bd53f8ed4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8edb expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756020.950129:0:5763:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784756020.950144:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff891382147e00/0xc0f560bd53f8ed4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8edb expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756020.950150:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff891382147e00/0xc0f560bd53f8ed4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8edb expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756020.950160:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756020.950166:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756020.950168:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756020.950184:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a5739ad-a70a-4582-8756-59cdd498af45:3290:1871452237215616:0@lo:103: 00000100:00100000:1.0:1784756020.950211:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756020.950275:0:5760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237215488 00000100:00100000:1.0:1784756020.950279:0:5760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237215488 00010000:00010000:1.0:1784756020.950299:0:5760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891342baf000/0xc0f560bd53f8f05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f8efe expref: 17 pid: 5767 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756020.950321:0:5760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237215616 00000100:00100000:1.0:1784756020.950324:0:5760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237215616 00010000:00010000:1.0:1784756020.950334:0:5760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891382146400/0xc0f560bd53f8edb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f8ed4 expref: 18 pid: 5767 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756020.950347:0:5760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784756020.950353:0:5760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346761f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a5739ad-a70a-4582-8756-59cdd498af45+18:3293:x1871452237215488:12345-0@lo:103: 00010000:00010000:1.0:1784756020.950365:0:5760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784756020.950370:0:5760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891342baf000/0xc0f560bd53f8f05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f8efe expref: 18 pid: 5767 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756020.950381:0:5760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891342baf000/0xc0f560bd53f8f05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0f560bd53f8efe expref: 18 pid: 5767 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756020.950395:0:5760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891342baf000/0xc0f560bd53f8f05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0f560bd53f8efe expref: 18 pid: 5767 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756020.950410:0:5760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784756020.950555:0:5759:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1784756020.950564:0:5759:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1784756020.950676:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784756020.950684:0:5759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375a82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a5739ad-a70a-4582-8756-59cdd498af45+17:3290:x1871452237215616:12345-0@lo:103: 00010000:00010000:3.0:1784756020.950693:0:5759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784756020.950698:0:5759:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891382146400/0xc0f560bd53f8edb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f8ed4 expref: 17 pid: 5767 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756020.950707:0:5759:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891382146400/0xc0f560bd53f8edb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0f560bd53f8ed4 expref: 17 pid: 5767 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756020.950717:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891382146400/0xc0f560bd53f8edb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0f560bd53f8ed4 expref: 17 pid: 5767 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756020.950738:0:5759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784756020.950787:0:5759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375a82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a5739ad-a70a-4582-8756-59cdd498af45+16:3290:x1871452237215616:12345-0@lo:103: Request processed in 104us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756020.950794:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1784756020.951187:0:5758:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1784756020.951197:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375ee4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3a5739ad-a70a-4582-8756-59cdd498af45+6:5767:x1871452237214976:12345-0@lo:104: Request processed in 1871us (2483us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756020.951227:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784756020.951248:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784756020.951255:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375ee5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3a5739ad-a70a-4582-8756-59cdd498af45+5:5767:x1871452237215104:12345-0@lo:104: 00010000:00010000:2.0:1784756020.951275:0:5758:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff89134151aa00/0xc0f560bd53f8eb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f8ebf expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756020.951326:0:5758:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784756020.951332:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375ee5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3a5739ad-a70a-4582-8756-59cdd498af45+5:5767:x1871452237215104:12345-0@lo:104: Request processed in 78us (2549us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756020.951337:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784756020.951350:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784756020.951356:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3a5739ad-a70a-4582-8756-59cdd498af45+4:5767:x1871452237215232:12345-0@lo:104: 00010000:00010000:2.0:1784756020.951364:0:5758:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff891342bae600/0xc0f560bd53f8e8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f8e95 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756020.951391:0:5758:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784756020.951395:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3a5739ad-a70a-4582-8756-59cdd498af45+4:5767:x1871452237215232:12345-0@lo:104: Request processed in 40us (2552us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756020.951400:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784756020.951412:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784756020.951438:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375ee7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3a5739ad-a70a-4582-8756-59cdd498af45+3:5767:x1871452237215360:12345-0@lo:104: 00010000:00010000:2.0:1784756020.951445:0:5758:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff891342baf600/0xc0f560bd53f8e64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f8e6b expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756020.951472:0:5758:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1784756020.951476:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375ee7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3a5739ad-a70a-4582-8756-59cdd498af45+3:5767:x1871452237215360:12345-0@lo:104: Request processed in 41us (2576us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756020.951487:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784756020.951525:0:5767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375ee7480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5767:1871452237215104:0@lo:104: 00000100:00100000:2.0:1784756020.951534:0:5767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375ee6d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5767:1871452237215232:0@lo:104: 00000100:00100000:2.0:1784756020.951541:0:5767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375ee4e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5767:1871452237215360:0@lo:104: 00010000:00010000:2.0:1784756020.951569:0:5767:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89134151b000/0xc0f560bd53f8f1a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756020.951864:0:5762:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784756020.951880:0:5762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff89134151aa00/0xc0f560bd53f8eb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f8ebf expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756020.951888:0:5762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89134151aa00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:3.0:1784756020.951892:0:5762:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff89134151aa00/0xc0f560bd53f8eb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0f560bd53f8ebf expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756020.951900:0:5762:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff89134151aa00/0xc0f560bd53f8eb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0f560bd53f8ebf expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784756020.951906:0:5762:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff89134151aa00/0xc0f560bd53f8eb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0f560bd53f8ebf expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784756020.951912:0:5762:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784756020.951943:0:5762:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff89134151aa00/0xc0f560bd53f8eb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8ebf expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756020.951949:0:5762:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784756020.951963:0:5762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff89134151aa00/0xc0f560bd53f8eb8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8ebf expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756020.951970:0:5762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff89134151aa00/0xc0f560bd53f8eb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8ebf expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756020.952005:0:5762:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784756020.952008:0:5762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff891342bae600/0xc0f560bd53f8e8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f8e95 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756020.952014:0:5762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891342bae600 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:3.0:1784756020.952016:0:5762:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff891342bae600/0xc0f560bd53f8e8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0f560bd53f8e95 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756020.952023:0:5762:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff891342bae600/0xc0f560bd53f8e8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0f560bd53f8e95 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784756020.952029:0:5762:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff891342bae600/0xc0f560bd53f8e8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0f560bd53f8e95 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784756020.952034:0:5762:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784756020.952048:0:5762:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff891342bae600/0xc0f560bd53f8e8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8e95 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756020.952054:0:5762:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1784756020.952275:0:5760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346761f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a5739ad-a70a-4582-8756-59cdd498af45+15:3293:x1871452237215488:12345-0@lo:103: Request processed in 1912us (2257us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756020.952284:0:5760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784756020.952322:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3a5739ad-a70a-4582-8756-59cdd498af45:3291:1871452237215744:0@lo:103: 00000100:00100000:1.0:1784756020.952357:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756020.952400:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375ee6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a5739ad-a70a-4582-8756-59cdd498af45:3292:1871452237215872:0@lo:103: 00000100:00100000:1.0:1784756020.952438:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756020.952471:0:5759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237215744 00000100:00100000:1.0:1784756020.952476:0:5759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237215744 00010000:00010000:1.0:1784756020.952495:0:5759:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891382146600/0xc0f560bd53f8ebf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f8eb8 expref: 15 pid: 5768 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756020.952514:0:5759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237215872 00000100:00100000:1.0:1784756020.952516:0:5759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237215872 00010000:00010000:1.0:1784756020.952526:0:5759:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891382147600/0xc0f560bd53f8e95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f8e8e expref: 16 pid: 5769 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756020.952542:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784756020.952548:0:5759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375a81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a5739ad-a70a-4582-8756-59cdd498af45+16:3291:x1871452237215744:12345-0@lo:103: 00010000:00010000:1.0:1784756020.952557:0:5759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784756020.952562:0:5759:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891382146600/0xc0f560bd53f8ebf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f8eb8 expref: 16 pid: 5768 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756020.952572:0:5759:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891382146600/0xc0f560bd53f8ebf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0f560bd53f8eb8 expref: 16 pid: 5768 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756020.952586:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891382146600/0xc0f560bd53f8ebf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0f560bd53f8eb8 expref: 16 pid: 5768 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756020.952599:0:5759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784756020.952627:0:5759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375a81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a5739ad-a70a-4582-8756-59cdd498af45+15:3291:x1871452237215744:12345-0@lo:103: Request processed in 79us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756020.952634:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784756020.952653:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784756020.952658:0:5759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a5739ad-a70a-4582-8756-59cdd498af45+14:3292:x1871452237215872:12345-0@lo:103: 00010000:00010000:1.0:1784756020.952666:0:5759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784756020.952670:0:5759:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891382147600/0xc0f560bd53f8e95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f8e8e expref: 14 pid: 5769 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756020.952678:0:5759:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891382147600/0xc0f560bd53f8e95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0f560bd53f8e8e expref: 14 pid: 5769 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756020.952687:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891382147600/0xc0f560bd53f8e95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0f560bd53f8e8e expref: 14 pid: 5769 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756020.952697:0:5759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784756020.952722:0:5759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a5739ad-a70a-4582-8756-59cdd498af45+13:3292:x1871452237215872:12345-0@lo:103: Request processed in 63us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756020.952727:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784756020.953099:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3a5739ad-a70a-4582-8756-59cdd498af45:3291:1871452237215744:0@lo:103: 00000100:00100000:1.0:1784756020.953131:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375ee6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a5739ad-a70a-4582-8756-59cdd498af45:3292:1871452237215872:0@lo:103: 00000100:00100000:1.0:1784756020.953151:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a5739ad-a70a-4582-8756-59cdd498af45:3290:1871452237215616:0@lo:103: 00010000:00010000:1.0:1784756020.953170:0:5763:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784756020.953591:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756020.953594:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756020.953596:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756020.953681:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff891342baf600/0xc0f560bd53f8e64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f8e6b expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756020.953691:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891342baf600 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:2.0:1784756020.953695:0:5763:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff891342baf600/0xc0f560bd53f8e64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0f560bd53f8e6b expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756020.953704:0:5763:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff891342baf600/0xc0f560bd53f8e64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0f560bd53f8e6b expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784756020.953712:0:5763:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff891342baf600/0xc0f560bd53f8e64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0f560bd53f8e6b expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784756020.953717:0:5763:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784756020.953763:0:5763:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff891342baf600/0xc0f560bd53f8e64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8e6b expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756020.953770:0:5763:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784756020.953784:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff891342baf600/0xc0f560bd53f8e64 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8e6b expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756020.953791:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff891342baf600/0xc0f560bd53f8e64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8e6b expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756020.953811:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756020.953813:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756020.953815:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756020.953822:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784756020.953833:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a5739ad-a70a-4582-8756-59cdd498af45:3292:1871452237216000:0@lo:103: 00000100:00100000:2.0:1784756020.953902:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756020.953947:0:5759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237216000 00000100:00100000:2.0:1784756020.953952:0:5759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237216000 00010000:00010000:2.0:1784756020.953972:0:5759:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89134151a600/0xc0f560bd53f8e6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f8e64 expref: 13 pid: 5768 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756020.953998:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784756020.954006:0:5759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346879f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a5739ad-a70a-4582-8756-59cdd498af45+13:3292:x1871452237216000:12345-0@lo:103: 00010000:00010000:2.0:1784756020.954016:0:5759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784756020.954021:0:5759:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89134151a600/0xc0f560bd53f8e6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f8e64 expref: 13 pid: 5768 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756020.954031:0:5759:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89134151a600/0xc0f560bd53f8e6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0f560bd53f8e64 expref: 13 pid: 5768 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756020.954043:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89134151a600/0xc0f560bd53f8e6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0f560bd53f8e64 expref: 13 pid: 5768 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756020.954058:0:5759:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89134151b000/0xc0f560bd53f8f1a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756020.954066:0:5759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89134151b000/0xc0f560bd53f8f1a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756020.954091:0:5759:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89134151b000/0xc0f560bd53f8f1a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756020.954099:0:5759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89134151b000/0xc0f560bd53f8f1a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756020.954106:0:5759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89134151b000/0xc0f560bd53f8f1a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756020.954112:0:5759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89134151b000/0xc0f560bd53f8f1a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756020.954117:0:5759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89134151b000 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:2.0:1784756020.954122:0:5759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89134151b000/0xc0f560bd53f8f1a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756020.954130:0:5759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89134151b000/0xc0f560bd53f8f1a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756020.954143:0:5759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89134151b000/0xc0f560bd53f8f1a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756020.954153:0:5759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784756020.954183:0:5759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346879f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a5739ad-a70a-4582-8756-59cdd498af45+12:3292:x1871452237216000:12345-0@lo:103: Request processed in 178us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756020.954190:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1784756020.954227:0:5767:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89134151b000/0xc0f560bd53f8f1a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756020.954235:0:5767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89134151b000/0xc0f560bd53f8f1a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756020.954248:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89134151b000/0xc0f560bd53f8f1a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784756020.954474:0:5767:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1784756020.955013:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3a5739ad-a70a-4582-8756-59cdd498af45:3293:1871452237215488:0@lo:103: 00010000:00010000:3.0:1784756020.955101:0:5762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff891342bae600/0xc0f560bd53f8e8e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8e95 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756020.955110:0:5762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff891342bae600/0xc0f560bd53f8e8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8e95 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756020.955127:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756020.955129:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756020.955131:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756020.955187:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a5739ad-a70a-4582-8756-59cdd498af45:3292:1871452237216000:0@lo:103: 00000100:00100000:2.0:1784756021.027022:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347ad1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+11:7458:x1871452237214720:12345-0@lo:253: Request processed in 97497us (107940us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756021.027039:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1784756021.027210:0:7458:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346760380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:7458:1871452237214720:0@lo:253: 10000000:01000000:1.0:1784756021.027375:0:7458:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1784756021.027379:0:7458:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784756021.027381:0:7458:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784756021.027382:0:7458:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784756021.027395:0:7458:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1784756021.027396:0:7458:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784756021.027398:0:7458:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784756021.027399:0:7458:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784756021.027401:0:7458:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1784756021.027403:0:7458:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784756021.027404:0:7458:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1784756021.027452:0:7458:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89136f870000 from lustre-OST0001 10000000:01000000:1.0:1784756021.027476:0:7458:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1784756021.027479:0:7458:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1784756021.027487:0:7458:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff891347b0b380 local copy 10000000:01000000:1.0:1784756021.027491:0:7458:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1784756021.027525:0:7458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8913429e5800/0xc0f560bd53f8f21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756021.027537:0:7458:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.141@tcp lock: ffff8913429e5800/0xc0f560bd53f8f21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756021.027547:0:7458:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8913429e5800/0xc0f560bd53f8f21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756021.027566:0:7458:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a80000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:7458:1871452237216128:0@lo:101: 00000100:00100000:1.0:1784756021.027606:0:7458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756021.027835:0:7458:0:(client.c:2702:ptlrpc_set_wait()) set ffff891381939540 going to sleep for 11 seconds 00000100:00100000:2.0:1784756021.028537:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237216128 00000100:00100000:2.0:1784756021.028546:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237216128 00000100:00100000:2.0:1784756021.028631:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1784756021.028641:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347ad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+11:7458:x1871452237216128:12345-0@lo:101: 00010000:00010000:2.0:1784756021.028656:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756021.028673:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891382147c00/0xc0f560bd53f8f28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0f560bd53f8f21 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756021.028698:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891382147c00/0xc0f560bd53f8f28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0f560bd53f8f21 expref: 12 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756021.028709:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891382147c00/0xc0f560bd53f8f28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8f21 expref: 12 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756021.028719:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891382147c00, rc 0) 00000100:00100000:2.0:1784756021.028773:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347ad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+12:7458:x1871452237216128:12345-0@lo:101: Request processed in 133us (1167us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756021.028779:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784756021.028856:0:7458:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a80000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:7458:1871452237216128:0@lo:101: 00010000:00010000:0.0:1784756021.028882:0:7458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8913429e5800/0xc0f560bd53f8f21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc0f560bd53f8f28 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756021.028892:0:7458:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8913429e5800/0xc0f560bd53f8f21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc0f560bd53f8f28 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756021.029043:0:7458:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346760e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:7458:1871452237216256:0@lo:501: 00000100:00100000:0.0:1784756021.029075:0:7458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756021.029570:0:7458:0:(client.c:2702:ptlrpc_set_wait()) set ffff89134924b900 going to sleep for 11 seconds 00000100:00100000:1.0:1784756021.029664:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237216256 00000100:00100000:1.0:1784756021.029670:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237216256 00000100:00100000:1.0:1784756021.029712:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1784756021.029720:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347ad0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+12:7458:x1871452237216256:12345-0@lo:501: 00000100:00100000:1.0:1784756021.029954:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347ad0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+12:7458:x1871452237216256:12345-0@lo:501: Request processed in 235us (877us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784756021.029962:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784756021.030137:0:7458:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346760e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:7458:1871452237216256:0@lo:501: 10000000:01000000:0.0:1784756021.030164:0:7458:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1784756021.030192:0:7458:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.141@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1784756021.030199:0:7458:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8913429e5800/0xc0f560bd53f8f21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc0f560bd53f8f28 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756021.030208:0:7458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8913429e5800/0xc0f560bd53f8f21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc0f560bd53f8f28 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756021.030229:0:7458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff8913429e5800/0xc0f560bd53f8f21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc0f560bd53f8f28 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756021.030251:0:7458:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784756021.030470:0:7465:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784756021.030485:0:7465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8913429e5800/0xc0f560bd53f8f21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xc0f560bd53f8f28 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756021.030493:0:7465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8913429e5800 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:1.0:1784756021.030497:0:7465:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8913429e5800/0xc0f560bd53f8f21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xc0f560bd53f8f28 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756021.030506:0:7465:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8913429e5800/0xc0f560bd53f8f21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xc0f560bd53f8f28 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784756021.030514:0:7465:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8913429e5800/0xc0f560bd53f8f21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xc0f560bd53f8f28 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784756021.030520:0:7465:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784756021.030546:0:7465:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8913429e5800/0xc0f560bd53f8f21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc0f560bd53f8f28 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756021.030552:0:7465:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784756021.030572:0:7465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8913429e5800/0xc0f560bd53f8f21 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc0f560bd53f8f28 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756021.030578:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8913429e5800/0xc0f560bd53f8f21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc0f560bd53f8f28 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756021.030597:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756021.030599:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756021.030600:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756021.030612:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a5739ad-a70a-4582-8756-59cdd498af45:3290:1871452237216384:0@lo:103: 00000100:00100000:1.0:1784756021.030647:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756021.030701:0:5760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237216384 00000100:00100000:1.0:1784756021.030706:0:5760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237216384 00000100:00100000:1.0:1784756021.030754:0:5760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784756021.030761:0:5760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375a82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a5739ad-a70a-4582-8756-59cdd498af45+12:3290:x1871452237216384:12345-0@lo:103: 00010000:00010000:1.0:1784756021.030772:0:5760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784756021.030784:0:5760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891382147c00/0xc0f560bd53f8f28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc0f560bd53f8f21 expref: 12 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756021.030798:0:5760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784756021.030825:0:5760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375a82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a5739ad-a70a-4582-8756-59cdd498af45+11:3290:x1871452237216384:12345-0@lo:103: Request processed in 65us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756021.030832:0:5760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784756021.030860:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a5739ad-a70a-4582-8756-59cdd498af45:3290:1871452237216384:0@lo:103: 10000000:01000000:0.0:1784756021.030950:0:7458:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89136f870000 10000000:01000000:0.0:1784756021.030957:0:7458:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1784756021.030963:0:7458:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1784756021.030966:0:7458:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784756021.030970:0:7458:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1784756021.030973:0:7458:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1784756021.031004:0:7458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff891342baf200/0xc0f560bd53f8f2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756021.031012:0:7458:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff891342baf200/0xc0f560bd53f8f2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756021.031021:0:7458:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff891342baf200/0xc0f560bd53f8f2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756021.031035:0:7458:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346760e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:7458:1871452237216512:0@lo:101: 00000100:00100000:0.0:1784756021.031063:0:7458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756021.031084:0:7458:0:(client.c:2702:ptlrpc_set_wait()) set ffff89134924bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784756021.031181:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237216512 00000100:00100000:1.0:1784756021.031186:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237216512 00000100:00100000:1.0:1784756021.031397:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1784756021.031407:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347ad3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+11:7458:x1871452237216512:12345-0@lo:101: 00010000:00010000:1.0:1784756021.031459:0:5768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784756021.031472:0:5768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8913429e5600/0xc0f560bd53f8f36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0f560bd53f8f2f expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756021.031495:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8913429e5600/0xc0f560bd53f8f36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0f560bd53f8f2f expref: 12 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756021.031506:0:5768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8913429e5600/0xc0f560bd53f8f36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8f2f expref: 12 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756021.031513:0:5768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8913429e5600, rc 0) 00000100:00100000:1.0:1784756021.031544:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347ad3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+12:7458:x1871452237216512:12345-0@lo:101: Request processed in 139us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756021.031550:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1784756021.031657:0:7458:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346760e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:7458:1871452237216512:0@lo:101: 00010000:00010000:0.0:1784756021.031670:0:7458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff891342baf200/0xc0f560bd53f8f2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8f36 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756021.031679:0:7458:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff891342baf200/0xc0f560bd53f8f2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0f560bd53f8f36 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756021.031760:0:7458:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346760e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:7458:1871452237216640:0@lo:501: 00000100:00100000:0.0:1784756021.031786:0:7458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756021.031955:0:7458:0:(client.c:2702:ptlrpc_set_wait()) set ffff89134924bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784756021.032443:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237216640 00000100:00100000:2.0:1784756021.032451:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237216640 00000100:00100000:2.0:1784756021.032485:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1784756021.032502:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347ad1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+12:7458:x1871452237216640:12345-0@lo:501: 00000100:00100000:2.0:1784756021.032745:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347ad1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+12:7458:x1871452237216640:12345-0@lo:501: Request processed in 243us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756021.032754:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1784756021.032883:0:7458:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346760e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:7458:1871452237216640:0@lo:501: 00000100:00100000:0.0:1784756021.032918:0:7458:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346760e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:7458:1871452237216768:0@lo:503: 00000100:00100000:0.0:1784756021.032960:0:7458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756021.033004:0:7458:0:(client.c:2702:ptlrpc_set_wait()) set ffff89134924bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784756021.033198:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237216768 00000100:00100000:3.0:1784756021.033203:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237216768 00000100:00100000:3.0:1784756021.033462:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784756021.033471:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347ad2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+12:7458:x1871452237216768:12345-0@lo:503: 00000100:00100000:3.0:1784756021.033652:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347ad2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+12:7458:x1871452237216768:12345-0@lo:503: Request processed in 182us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756021.033659:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1784756021.033825:0:7458:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346760e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:7458:1871452237216768:0@lo:503: 00000040:00080000:0.0:1784756021.034154:0:7458:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784756021.034531:0:7458:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346760e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:7458:1871452237216896:0@lo:502: 00000100:00100000:0.0:1784756021.034583:0:7458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756021.034622:0:7458:0:(client.c:2702:ptlrpc_set_wait()) set ffff89134924bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784756021.034727:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237216896 00000100:00100000:3.0:1784756021.034732:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237216896 00000100:00100000:3.0:1784756021.034762:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1784756021.034771:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+12:7458:x1871452237216896:12345-0@lo:502: 00000100:00100000:3.0:1784756021.034969:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+12:7458:x1871452237216896:12345-0@lo:502: Request processed in 198us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756021.034975:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784756021.035140:0:7458:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346760e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:7458:1871452237216896:0@lo:502: 00000040:00080000:0.0:1784756021.035679:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1784756021.035737:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1784756021.035771:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1784756021.035819:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1784756021.035857:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1784756021.035907:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1784756021.035951:0:7458:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346760e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:7458:1871452237217024:0@lo:502: 00000100:00100000:0.0:1784756021.036006:0:7458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756021.036042:0:7458:0:(client.c:2702:ptlrpc_set_wait()) set ffff89134924bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784756021.036067:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237217024 00000100:00100000:0.0:1784756021.036073:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237217024 00000100:00100000:0.0:1784756021.036111:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1784756021.036119:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+12:7458:x1871452237217024:12345-0@lo:502: 00000100:00100000:0.0:1784756021.036760:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+12:7458:x1871452237217024:12345-0@lo:502: Request processed in 638us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756021.036770:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1784756021.036920:0:7458:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346760e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:7458:1871452237217024:0@lo:502: 00000040:00080000:2.0:1784756021.037044:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1784756021.037056:0:7458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1784756021.038089:0:7468:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784756021.038098:0:7468:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1784756021.038106:0:7468:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784756021.038109:0:7468:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1784756021.038115:0:7468:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784756021.038131:0:7468:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff891347b08000) 00000020:00000080:2.0:1784756021.038155:0:7468:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1784756021.038160:0:7468:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1784756021.038585:0:7468:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89136f870000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1784756021.038595:0:7468:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1784756021.038604:0:7468:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc0f560bd53f8f44 00010000:00010000:1.0:1784756021.044985:0:7468:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1784756021.045454:0:7468:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1784756021.050826:0:7468:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1784756021.051203:0:7468:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00000100:00100000:0.0:1784756021.051529:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346762680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1871452237217408:0@lo:400: 00000100:00100000:0.0:1784756021.051614:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756021.051660:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784756021.051666:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346760000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3293:1871452237217280:0@lo:400: 00000100:00100000:0.0:1784756021.051690:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756021.051724:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237217408 00000100:00100000:0.0:1784756021.051732:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237217408 00000100:00100000:0.0:1784756021.051810:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784756021.051820:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346761c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1871452237217408:12345-0@lo:400: 00000100:00100000:0.0:1784756021.051885:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346761c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1871452237217408:12345-0@lo:400: Request processed in 67us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756021.051892:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784756021.051920:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237217280 00000100:00100000:0.0:1784756021.051923:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237217280 00000100:00100000:0.0:1784756021.051950:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784756021.051967:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1871452237217280:12345-0@lo:400: 00000100:00100000:0.0:1784756021.051995:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1871452237217280:12345-0@lo:400: Request processed in 30us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756021.052002:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1784756021.052018:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784756021.052022:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784756021.052056:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891346760000 x1871452237217280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784756037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756021.052071:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346760000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3293:1871452237217280:0@lo:400: 00010000:00080000:0.0:1784756021.052080:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891346762680 x1871452237217408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756021.052088:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346762680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1871452237217408:0@lo:400: 00000100:00100000:3.0:1784756021.052168:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784756021.052179:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346763100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3290:1871452237217152:0@lo:400: 00000100:00100000:3.0:1784756021.052207:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756021.052571:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237217152 00000100:00100000:0.0:1784756021.052576:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237217152 00000100:00100000:0.0:1784756021.052604:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784756021.052611:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1871452237217152:12345-0@lo:400: 00000100:00100000:0.0:1784756021.052661:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1871452237217152:12345-0@lo:400: Request processed in 50us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756021.052667:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1784756021.052786:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891346763100 x1871452237217152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784756037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756021.052797:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346763100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3290:1871452237217152:0@lo:400: 00080000:10000000:1.0:1784756021.060164:0:7468:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1784756021.062182:0:7468:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1784756021.068521:0:7468:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1784756021.068534:0:7468:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784756021.068541:0:7468:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784756021.068543:0:7468:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1784756021.068547:0:7468:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784756021.068551:0:7468:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784756021.068552:0:7468:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1784756021.068555:0:7468:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784756021.068557:0:7468:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1784756021.068616:0:7468:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784756021.068620:0:7468:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784756021.068621:0:7468:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1784756021.068624:0:7468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1784756021.069151:0:7458:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1784756021.069177:0:7458:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1784756021.069201:0:7458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff891342baf200/0xc0f560bd53f8f2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8f36 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756021.069748:0:7458:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff891342baf200/0xc0f560bd53f8f2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8f36 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784756021.069761:0:7458:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89136f870000 from 1 10000000:01000000:2.0:1784756021.069763:0:7458:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784756021.069810:0:7458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff891382147200/0xc0f560bd53f8f4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756021.069818:0:7458:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff891382147200/0xc0f560bd53f8f4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756021.069828:0:7458:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff891382147200/0xc0f560bd53f8f4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756021.069850:0:7458:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89134687a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:7458:1871452237217536:0@lo:101: 00000100:00100000:2.0:1784756021.069928:0:7458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756021.069977:0:7458:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913469c3480 going to sleep for 11 seconds 00000100:00100000:0.0:1784756021.070145:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237217536 00000100:00100000:0.0:1784756021.070152:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237217536 00000100:00100000:0.0:1784756021.070204:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1784756021.070225:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+12:7458:x1871452237217536:12345-0@lo:101: 00010000:00010000:0.0:1784756021.070240:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756021.070252:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891342baee00/0xc0f560bd53f8f52 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0f560bd53f8f4b expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756021.070460:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891342baee00/0xc0f560bd53f8f52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0f560bd53f8f4b expref: 13 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756021.070472:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891342baee00/0xc0f560bd53f8f52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8f4b expref: 13 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756021.070480:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891342baee00, rc 0) 00000100:00100000:0.0:1784756021.070526:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+13:7458:x1871452237217536:12345-0@lo:101: Request processed in 313us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756021.070533:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1784756021.070962:0:7458:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89134687a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:7458:1871452237217536:0@lo:101: 00010000:00010000:2.0:1784756021.070978:0:7458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff891382147200/0xc0f560bd53f8f4b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8f52 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756021.070988:0:7458:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff891382147200/0xc0f560bd53f8f4b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0f560bd53f8f52 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756021.071099:0:7458:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89134687a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:7458:1871452237217664:0@lo:501: 00000100:00100000:2.0:1784756021.071131:0:7458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756021.071167:0:7458:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913469c3480 going to sleep for 11 seconds 00000100:00100000:0.0:1784756021.071589:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237217664 00000100:00100000:0.0:1784756021.071595:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237217664 00000100:00100000:0.0:1784756021.071631:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1784756021.071638:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+13:7458:x1871452237217664:12345-0@lo:501: 00000100:00100000:0.0:1784756021.071899:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+13:7458:x1871452237217664:12345-0@lo:501: Request processed in 260us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756021.071906:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1784756021.072036:0:7458:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89134687a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:7458:1871452237217664:0@lo:501: 00000100:00100000:2.0:1784756021.072065:0:7458:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89134687a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:7458:1871452237217792:0@lo:503: 00000100:00100000:2.0:1784756021.072104:0:7458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756021.072134:0:7458:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913469c3480 going to sleep for 11 seconds 00000100:00100000:1.0:1784756021.072172:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237217792 00000100:00100000:1.0:1784756021.072176:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237217792 00000100:00100000:1.0:1784756021.072207:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1784756021.072213:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+13:7458:x1871452237217792:12345-0@lo:503: 00000100:00100000:1.0:1784756021.072548:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+13:7458:x1871452237217792:12345-0@lo:503: Request processed in 334us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756021.072555:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1784756021.072854:0:7458:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89134687a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:7458:1871452237217792:0@lo:503: 00000040:00080000:2.0:1784756021.073132:0:7458:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784756021.073210:0:7458:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89134687a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:7458:1871452237217920:0@lo:502: 00000100:00100000:2.0:1784756021.073398:0:7458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756021.073467:0:7458:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913469c3480 going to sleep for 11 seconds 00000100:00100000:0.0:1784756021.073585:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237217920 00000100:00100000:0.0:1784756021.073590:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237217920 00000100:00100000:0.0:1784756021.073631:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1784756021.073639:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+13:7458:x1871452237217920:12345-0@lo:502: 00000100:00100000:0.0:1784756021.073805:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+13:7458:x1871452237217920:12345-0@lo:502: Request processed in 167us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756021.073813:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1784756021.073903:0:7458:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89134687a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:7458:1871452237217920:0@lo:502: 00000040:00080000:2.0:1784756021.074159:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1784756021.074207:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1784756021.074470:0:7458:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89134687a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:7458:1871452237218048:0@lo:502: 00000100:00100000:2.0:1784756021.074509:0:7458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756021.074539:0:7458:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913469c3480 going to sleep for 11 seconds 00000100:00100000:0.0:1784756021.074597:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237218048 00000100:00100000:0.0:1784756021.074602:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237218048 00000100:00100000:0.0:1784756021.074638:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1784756021.074651:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+13:7458:x1871452237218048:12345-0@lo:502: 00000100:00100000:0.0:1784756021.074786:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+13:7458:x1871452237218048:12345-0@lo:502: Request processed in 136us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756021.074793:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1784756021.074836:0:7458:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89134687a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:7458:1871452237218048:0@lo:502: 00000040:00080000:0.0:1784756021.074933:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1784756021.074945:0:7458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1784756021.075792:0:7472:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784756021.075804:0:7472:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784756021.075806:0:7472:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1784756021.075813:0:7472:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff89136f870000 00000020:00000080:1.0:1784756021.075816:0:7472:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784756021.075851:0:7472:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784756021.075854:0:7472:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784756021.075856:0:7472:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1784756021.075858:0:7472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1784756021.076001:0:7458:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1784756021.076020:0:7458:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784756021.076040:0:7458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff891382147200/0xc0f560bd53f8f4b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8f52 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756021.076052:0:7458:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff891382147200/0xc0f560bd53f8f4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8f52 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784756021.076090:0:7458:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1784756021.076093:0:7458:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89136f870000 10000000:01000000:0.0:1784756021.076096:0:7458:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89136f870000 10000000:01000000:0.0:1784756021.076101:0:7458:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784756021.076106:0:7458:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89136f870000 from 1 10000000:01000000:0.0:1784756021.076109:0:7458:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784756021.076140:0:7458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff891342bafe00/0xc0f560bd53f8f59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756021.076148:0:7458:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff891342bafe00/0xc0f560bd53f8f59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756021.076157:0:7458:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff891342bafe00/0xc0f560bd53f8f59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756021.076184:0:7458:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346762680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:7458:1871452237218176:0@lo:101: 00000100:00100000:0.0:1784756021.076558:0:7458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756021.076637:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237218176 00000100:00100000:2.0:1784756021.076643:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237218176 00000100:00100000:2.0:1784756021.076683:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1784756021.076692:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+13:7458:x1871452237218176:12345-0@lo:101: 00010000:00010000:2.0:1784756021.076704:0:5768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756021.076717:0:5768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891382147c00/0xc0f560bd53f8f60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0f560bd53f8f59 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756021.076739:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891382147c00/0xc0f560bd53f8f60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0f560bd53f8f59 expref: 14 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756021.076750:0:5768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891382147c00/0xc0f560bd53f8f60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8f59 expref: 14 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756021.076758:0:5768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891382147c00, rc 0) 00000100:00100000:2.0:1784756021.076789:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+14:7458:x1871452237218176:12345-0@lo:101: Request processed in 98us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756021.076796:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1784756021.076835:0:7458:0:(client.c:2702:ptlrpc_set_wait()) set ffff891381939180 going to sleep for 11 seconds 00000100:00100000:2.0:1784756021.076862:0:7458:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346762680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:7458:1871452237218176:0@lo:101: 00010000:00010000:2.0:1784756021.076885:0:7458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff891342bafe00/0xc0f560bd53f8f59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8f60 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756021.076894:0:7458:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff891342bafe00/0xc0f560bd53f8f59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0f560bd53f8f60 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756021.076972:0:7458:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89134687a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:7458:1871452237218304:0@lo:501: 00000100:00100000:2.0:1784756021.077053:0:7458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756021.077127:0:7458:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913469c3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784756021.079756:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237218304 00000100:00100000:1.0:1784756021.079769:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237218304 00000100:00100000:1.0:1784756021.079854:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1784756021.079865:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+14:7458:x1871452237218304:12345-0@lo:501: 00000100:00100000:1.0:1784756021.080384:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+14:7458:x1871452237218304:12345-0@lo:501: Request processed in 518us (3326us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756021.080394:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1784756021.081473:0:7458:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89134687a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:7458:1871452237218304:0@lo:501: 00000100:00100000:3.0:1784756021.081527:0:7458:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375ee4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:7458:1871452237218432:0@lo:503: 00000100:00100000:3.0:1784756021.081590:0:7458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756021.081633:0:7458:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913584a4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784756021.081862:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237218432 00000100:00100000:2.0:1784756021.081878:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237218432 00000100:00100000:2.0:1784756021.081924:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1784756021.081932:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+14:7458:x1871452237218432:12345-0@lo:503: 00000100:00100000:2.0:1784756021.082174:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+14:7458:x1871452237218432:12345-0@lo:503: Request processed in 242us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756021.082182:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1784756021.082450:0:7458:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375ee4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:7458:1871452237218432:0@lo:503: 00000040:00080000:3.0:1784756021.082734:0:7458:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784756021.082808:0:7458:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375ee4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:7458:1871452237218560:0@lo:502: 00000100:00100000:3.0:1784756021.082849:0:7458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756021.083309:0:7458:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913584a4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784756021.084602:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237218560 00000100:00100000:0.0:1784756021.084615:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237218560 00000100:00100000:0.0:1784756021.084664:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1784756021.084673:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+14:7458:x1871452237218560:12345-0@lo:502: 00000100:00100000:0.0:1784756021.085120:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+14:7458:x1871452237218560:12345-0@lo:502: Request processed in 446us (2269us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756021.085128:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1784756021.086062:0:7458:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375ee4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:7458:1871452237218560:0@lo:502: 00000040:00080000:2.0:1784756021.087061:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1784756021.087128:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1784756021.087165:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1784756021.087210:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1784756021.087757:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1784756021.087831:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1784756021.087893:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1784756021.087931:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1784756021.087998:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1784756021.088035:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1784756021.088067:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1784756021.088115:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1784756021.088151:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1784756021.088193:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1784756021.088581:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1784756021.088625:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1784756021.088659:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1784756021.088708:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1784756021.088743:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1784756021.088775:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1784756021.088838:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1784756021.088887:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1784756021.088922:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1784756021.088983:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1784756021.089030:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1784756021.089068:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1784756021.089126:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1784756021.089166:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1784756021.089200:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1784756021.089581:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1784756021.089621:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1784756021.089655:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1784756021.089688:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1784756021.089736:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1784756021.089770:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1784756021.089813:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1784756021.089845:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1784756021.089902:0:7458:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346878380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:7458:1871452237218688:0@lo:502: 00000100:00100000:2.0:1784756021.089986:0:7458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756021.090412:0:7458:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913469c3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784756021.090708:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237218688 00000100:00100000:0.0:1784756021.090715:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237218688 00000100:00100000:0.0:1784756021.090762:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1784756021.090771:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+14:7458:x1871452237218688:12345-0@lo:502: 00000100:00100000:0.0:1784756021.091041:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+14:7458:x1871452237218688:12345-0@lo:502: Request processed in 270us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756021.091049:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1784756021.091281:0:7458:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346878380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:7458:1871452237218688:0@lo:502: 00000040:00080000:3.0:1784756021.091372:0:7458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1784756021.091388:0:7458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1784756021.092520:0:7473:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1784756021.092537:0:7473:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff89134671b380) 00000020:00000080:3.0:1784756021.092573:0:7473:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1784756021.092726:0:7473:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89136f870000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1784756021.092731:0:7473:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89136f870000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1784756021.092734:0:7473:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89136f870000 3 00010000:00080000:3.0:1784756021.092760:0:7473:0:(ldlm_lib.c:102:import_set_conn()) imp ffff891375e50800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.141@tcp at head 00010000:00010000:3.0:1784756021.111198:0:7473:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1784756021.112610:0:7473:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1784756021.112660:0:7473:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784756021.112675:0:7473:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc0f560bd53f8f6e 00000100:00080000:3.0:1784756021.112688:0:7473:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784756021.112695:0:7473:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff891375e50800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1784756021.112735:0:7473:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff891375ee4a80 x1871452237218816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784756021.112800:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375ee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3289:1871452237218816:0@lo:38: 00000100:00100000:1.0:1784756021.112883:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784756021.113006:0:7473:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1784756021.113690:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237218816 00000100:00100000:0.0:1784756021.113699:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237218816 00000100:00100000:0.0:1784756021.113770:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784756021.113778:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375a81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3289:x1871452237218816:12345-0@lo:38: 00010000:00080000:0.0:1784756021.113803:0:5775:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 138 last 0 00000020:00000080:0.0:1784756021.113837:0:5775:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc0f560bd53f8f75 00000004:00100000:0.0:1784756021.113853:0:5775:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784756021.113896:0:5775:0:(import.c:65:import_set_state_nolock()) ffff89136c2e7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784756021.114133:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375a81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1871452237218816:12345-0@lo:38: Request processed in 353us (1248us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756021.114154:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1784756021.115161:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891375ee4a80 x1871452237218816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784756031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756021.115175:0:3289:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784756021.115183:0:3289:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1784756021.115190:0:3289:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1784756021.115195:0:3289:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1784756021.115197:0:3289:0:(import.c:65:import_set_state_nolock()) ffff891375e50800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1784756021.115204:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375ee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3289:1871452237218816:0@lo:38: 00000040:00080000:3.0:1784756021.115886:0:7473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1784756021.116090:0:7458:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1784756021.116120:0:7458:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784756021.116146:0:7458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff891342bafe00/0xc0f560bd53f8f59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8f60 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756021.116170:0:7458:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff891342bafe00/0xc0f560bd53f8f59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8f60 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784756021.116234:0:7458:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1784756021.116237:0:7458:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784756021.116238:0:7458:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784756021.116239:0:7458:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784756021.116241:0:7458:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784756021.116242:0:7458:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784756021.116244:0:7458:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784756021.116245:0:7458:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784756021.116247:0:7458:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784756021.116249:0:7458:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784756021.116250:0:7458:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784756021.116254:0:7458:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1784756021.116257:0:7458:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784756021.116258:0:7458:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784756021.116259:0:7458:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784756021.116260:0:7458:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784756021.116261:0:7458:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784756021.116263:0:7458:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784756021.116275:0:7458:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784756021.116276:0:7458:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784756021.116277:0:7458:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784756021.116278:0:7458:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784756021.116279:0:7458:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784756021.116305:0:7458:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1784756021.116323:0:7458:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89134687ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:7458:1871452237218944:0@lo:253: 00000100:00100000:2.0:1784756021.116389:0:7458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756021.116456:0:7458:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913469c3480 going to sleep for 11 seconds 00000100:00100000:0.0:1784756021.116880:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237218944 00000100:00100000:0.0:1784756021.116888:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237218944 00000100:00100000:0.0:1784756021.116975:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1784756021.116984:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+14:7458:x1871452237218944:12345-0@lo:253: 20000000:01000000:0.0:1784756021.117078:0:5767:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1784756021.117092:0:5767:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1784756021.117979:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346760000 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7475:1871452237219072:0@lo:901: 00000100:00100000:0.0:1784756021.118133:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756021.118165:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set ffff89137cf61000 going to sleep for 11 seconds 00000100:00100000:1.0:1784756021.118407:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237219072 00000100:00100000:1.0:1784756021.118738:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237219072 00000100:00080000:0.0:1784756021.118975:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784756021.119034:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784756021.119045:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346762680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7475:x1871452237219072:12345-0@lo:901: 00000100:00100000:2.0:1784756021.119750:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346762680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7475:x1871452237219072:12345-0@lo:901: Request processed in 704us (1615us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756021.119768:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1784756021.119895:0:7475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891346760000 x1871452237219072/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1784756037 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756021.119912:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346760000 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7475:1871452237219072:0@lo:901: 20000000:01000000:1.0:1784756021.158952:0:5767:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784756021.158972:0:5767:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1784756021.159083:0:5790:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784756021.159088:0:5790:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784756021.159109:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff891382147600/0xc0f560bd53f8f7c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756021.159128:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891342baea00/0xc0f560bd53f8ecd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8ec6 expref: 14 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756021.159138:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff891382147600/0xc0f560bd53f8f7c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756021.159180:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891342baea00/0xc0f560bd53f8ecd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0f560bd53f8ec6 expref: 14 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756021.159193:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff891342baea00/0xc0f560bd53f8ecd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0f560bd53f8ec6 expref: 14 pid: 5768 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756021.159208:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89134687b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5790:1871452237219200:0@lo:104: 00000100:00100000:2.0:1784756021.159291:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756021.159334:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913750cfa80 going to sleep for 11 seconds 00000100:00100000:2.0:1784756021.159352:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237219200 00000100:00100000:2.0:1784756021.159359:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237219200 00000100:00100000:2.0:1784756021.159435:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784756021.159446:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346878700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3a5739ad-a70a-4582-8756-59cdd498af45+3:5790:x1871452237219200:12345-0@lo:104: 00010000:00010000:2.0:1784756021.159459:0:5757:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff891382147a00/0xc0f560bd53f8ec6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f8ecd expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756021.159619:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89134687b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5790:1871452237219200:0@lo:104: 00010000:00010000:1.0:1784756021.159639:0:5790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff891382147600/0xc0f560bd53f8f7c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756021.159820:0:5757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784756021.159827:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346878700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3a5739ad-a70a-4582-8756-59cdd498af45+3:5790:x1871452237219200:12345-0@lo:104: Request processed in 383us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756021.159842:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1784756021.159858:0:5763:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784756021.159864:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff891382147a00/0xc0f560bd53f8ec6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f8ecd expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756021.159882:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891382147a00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:3.0:1784756021.159886:0:5763:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff891382147a00/0xc0f560bd53f8ec6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0f560bd53f8ecd expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756021.159901:0:5763:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff891382147a00/0xc0f560bd53f8ec6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0f560bd53f8ecd expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784756021.159908:0:5763:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff891382147a00/0xc0f560bd53f8ec6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0f560bd53f8ecd expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784756021.159914:0:5763:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784756021.159950:0:5763:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff891382147a00/0xc0f560bd53f8ec6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8ecd expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756021.159956:0:5763:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784756021.159972:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff891382147a00/0xc0f560bd53f8ec6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8ecd expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756021.159979:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff891382147a00/0xc0f560bd53f8ec6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8ecd expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756021.159995:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756021.159997:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756021.159999:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756021.160111:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375ee5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a5739ad-a70a-4582-8756-59cdd498af45:3290:1871452237219328:0@lo:103: 00000100:00100000:2.0:1784756021.160145:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756021.160188:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237219328 00000100:00100000:2.0:1784756021.160191:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237219328 00010000:00010000:2.0:1784756021.160210:0:5761:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891342baea00/0xc0f560bd53f8ecd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f8ec6 expref: 15 pid: 5768 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756021.160711:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784756021.160721:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913469c6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a5739ad-a70a-4582-8756-59cdd498af45+15:3290:x1871452237219328:12345-0@lo:103: 00010000:00010000:2.0:1784756021.160734:0:5761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784756021.160739:0:5761:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891342baea00/0xc0f560bd53f8ecd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f8ec6 expref: 15 pid: 5768 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756021.160751:0:5761:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891342baea00/0xc0f560bd53f8ecd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0f560bd53f8ec6 expref: 15 pid: 5768 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756021.160766:0:5761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891342baea00/0xc0f560bd53f8ecd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0f560bd53f8ec6 expref: 15 pid: 5768 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756021.160781:0:5761:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff891382147600/0xc0f560bd53f8f7c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756021.160789:0:5761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891382147600/0xc0f560bd53f8f7c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784756021.160803:0:5761:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002478927s 00010000:00010000:2.0:1784756021.160808:0:5761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff891382147600/0xc0f560bd53f8f7c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756021.160829:0:5761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff891382147600/0xc0f560bd53f8f7c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756021.160836:0:5761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff891382147600/0xc0f560bd53f8f7c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756021.160844:0:5761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff891382147600/0xc0f560bd53f8f7c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756021.160849:0:5761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891382147600 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:2.0:1784756021.160853:0:5761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff891382147600/0xc0f560bd53f8f7c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756021.160861:0:5761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff891382147600/0xc0f560bd53f8f7c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756021.160885:0:5761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff891382147600/0xc0f560bd53f8f7c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756021.160896:0:5761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784756021.160945:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913469c6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a5739ad-a70a-4582-8756-59cdd498af45+14:3290:x1871452237219328:12345-0@lo:103: Request processed in 226us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756021.160952:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784756021.160976:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375ee5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a5739ad-a70a-4582-8756-59cdd498af45:3290:1871452237219328:0@lo:103: 00010000:00010000:1.0:1784756021.164340:0:5790:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff891382147600/0xc0f560bd53f8f7c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756021.164360:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff891382147600/0xc0f560bd53f8f7c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756021.164375:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891382147600/0xc0f560bd53f8f7c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756021.173322:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+13:7458:x1871452237218944:12345-0@lo:253: Request processed in 56329us (56922us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756021.173339:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1784756021.173471:0:7458:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89134687ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3a5739ad-a70a-4582-8756-59cdd498af45:7458:1871452237218944:0@lo:253: 10000000:01000000:3.0:1784756021.173487:0:7458:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1784756021.173490:0:7458:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784756021.173492:0:7458:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784756021.173494:0:7458:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784756021.173495:0:7458:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784756021.173496:0:7458:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784756021.173497:0:7458:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784756021.173498:0:7458:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784756021.173521:0:7458:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784756021.173523:0:7458:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784756021.173524:0:7458:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784756021.173525:0:7458:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1784756021.173540:0:7458:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1784756021.181612:0:7458:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1784756021.181801:0:7458:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1784756021.182129:0:7458:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1784756021.182671:0:7458:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1784756021.182909:0:7458:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1784756021.183135:0:7458:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1784756021.185179:0:7458:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1784756021.422807:0:7458:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1784756021.422814:0:7458:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1784756021.422847:0:7458:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1784756021.422928:0:7458:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.141@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1784756021.422945:0:7458:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1784756021.422978:0:7458:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:3.0:1784756021.556202:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784756021.556296:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237219456:0@lo:13: 00000100:00100000:3.0:1784756021.556378:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756021.556504:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237219456 00000100:00100000:1.0:1784756021.556513:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237219456 00000100:00100000:1.0:1784756021.556568:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784756021.556578:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375ee5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1871452237219456:12345-0@lo:13: 00002000:00000024:1.0:1784756021.556615:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784756021.556672:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375ee5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1871452237219456:12345-0@lo:13: Request processed in 96us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756021.556680:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1784756021.556742:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff891375a83b80 x1871452237219456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756037 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756021.556775:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237219456:0@lo:13: 00010000:00010000:0.0:1784756021.625466:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756022.655777:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756023.669334:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756024.692058:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756025.724875:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756026.164583:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346763100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3293:1871452237219712:0@lo:400: 00000100:00100000:0.0:1784756026.164583:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346760e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3290:1871452237219840:0@lo:400: 00000100:00100000:3.0:1784756026.164655:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346760000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a5739ad-a70a-4582-8756-59cdd498af45:3292:1871452237219584:0@lo:400: 00000100:00100000:2.0:1784756026.167977:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756026.170610:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237219712 00000100:00100000:1.0:1784756026.170626:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237219712 00000100:00100000:1.0:1784756026.170689:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784756026.170699:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346879f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1871452237219712:12345-0@lo:400: 00000100:00100000:1.0:1784756026.170810:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346879f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1871452237219712:12345-0@lo:400: Request processed in 112us (2844us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756026.170818:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784756026.170864:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346760380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3291:1871452237219968:0@lo:400: 00000100:00100000:1.0:1784756026.170906:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1784756026.171087:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891346763100 x1871452237219712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784756042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756026.171102:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346763100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3293:1871452237219712:0@lo:400: 00000100:00100000:0.0:1784756026.171322:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756026.171381:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237219840 00000100:00100000:2.0:1784756026.171385:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237219840 00000100:00100000:2.0:1784756026.171522:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784756026.171529:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346763800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1871452237219840:12345-0@lo:400: 00000100:00100000:2.0:1784756026.171572:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346763800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1871452237219840:12345-0@lo:400: Request processed in 43us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756026.171578:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1784756026.171608:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891346760e00 x1871452237219840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784756042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756026.171619:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346760e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3290:1871452237219840:0@lo:400: 00000100:00080000:1.0:1784756026.171696:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784756026.172516:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237219968 00000100:00100000:1.0:1784756026.172523:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237219968 00000100:00100000:1.0:1784756026.172570:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784756026.172578:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1871452237219968:12345-0@lo:400: 00000100:00100000:1.0:1784756026.172630:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1871452237219968:12345-0@lo:400: Request processed in 54us (1724us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756026.172637:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1784756026.172653:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784756026.172677:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891346760380 x1871452237219968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756026.172688:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346760380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3291:1871452237219968:0@lo:400: 00000100:00100000:3.0:1784756026.174731:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756026.176674:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346761500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3292:1871452237220096:0@lo:400: 00000100:00100000:3.0:1784756026.176733:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756026.178728:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237220096 00000100:00100000:1.0:1784756026.178732:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237219584 00000100:00100000:2.0:1784756026.178743:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237220096 00000100:00100000:1.0:1784756026.178743:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237219584 00000100:00100000:1.0:1784756026.178969:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1784756026.178982:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+13:3292:x1871452237219584:12345-0@lo:400: 00000100:00100000:1.0:1784756026.179146:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+13:3292:x1871452237219584:12345-0@lo:400: Request processed in 167us (4421us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756026.179155:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1784756026.179206:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784756026.180893:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784756026.180916:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375ee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1871452237220096:12345-0@lo:400: 00000100:00100000:3.0:1784756026.180970:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346760000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a5739ad-a70a-4582-8756-59cdd498af45:3292:1871452237219584:0@lo:400: 00000100:00100000:2.0:1784756026.180992:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375ee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1871452237220096:12345-0@lo:400: Request processed in 86us (4258us total) trans 0 rc 0/0 00010000:00080000:3.0:1784756026.180995:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891346761500 x1871452237220096/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784756042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756026.181006:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784756026.181016:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346761500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3292:1871452237220096:0@lo:400: 00000100:00100000:1.0:1784756026.675632:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784756026.675661:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237220224:0@lo:13: 00000100:00100000:1.0:1784756026.675742:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756026.675809:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237220224 00000100:00100000:1.0:1784756026.675825:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237220224 00000100:00100000:1.0:1784756026.675877:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784756026.675884:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375a81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237220224:12345-0@lo:13: 00002000:00000024:1.0:1784756026.675920:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784756026.675960:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375a81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237220224:12345-0@lo:13: Request processed in 77us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756026.675967:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1784756026.676010:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891375a82680 x1871452237220224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756042 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756026.676030:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237220224:0@lo:13: 00010000:00010000:3.0:1784756026.739726:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784756027.754235:0:7818:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1784756027.764300:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756028.789219:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784756029.240692:0:5772:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784756029.240700:0:5772:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff891342e9d800 from 30 10000000:01000000:2.0:1784756029.240706:0:5772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784756029.240751:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff891382147a00/0xc0f560bd53f8f83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756029.240763:0:5772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff891382147a00/0xc0f560bd53f8f83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756029.240773:0:5772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff891382147a00/0xc0f560bd53f8f83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756029.240806:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89134687aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237220352:0@lo:101: 00000100:00100000:2.0:1784756029.240875:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756029.240920:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff891347be8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784756029.241530:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237220352 00000100:00100000:1.0:1784756029.241539:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237220352 00000100:00100000:1.0:1784756029.241595:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1784756029.241604:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+13:5772:x1871452237220352:12345-0@lo:101: 00010000:00010000:1.0:1784756029.241619:0:6669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784756029.241633:0:6669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8913429e4000/0xc0f560bd53f8f8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0f560bd53f8f83 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756029.241658:0:6669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8913429e4000/0xc0f560bd53f8f8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0f560bd53f8f83 expref: 14 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756029.241668:0:6669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8913429e4000/0xc0f560bd53f8f8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8f83 expref: 14 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756029.241678:0:6669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8913429e4000, rc 0) 00000100:00100000:1.0:1784756029.243886:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+14:5772:x1871452237220352:12345-0@lo:101: Request processed in 2274us (3000us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756029.243907:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1784756029.244291:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89134687aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237220352:0@lo:101: 00010000:00010000:3.0:1784756029.244316:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff891382147a00/0xc0f560bd53f8f83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8f8a expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756029.244328:0:5772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff891382147a00/0xc0f560bd53f8f83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0f560bd53f8f8a expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756029.244401:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375ee4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237220480:0@lo:501: 00000100:00100000:2.0:1784756029.247065:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756029.247115:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff89136bcaf900 going to sleep for 11 seconds 00000100:00100000:1.0:1784756029.247174:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237220480 00000100:00100000:1.0:1784756029.247183:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237220480 00000100:00100000:1.0:1784756029.247238:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1784756029.247248:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+14:5772:x1871452237220480:12345-0@lo:501: 00000100:00100000:1.0:1784756029.247639:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+14:5772:x1871452237220480:12345-0@lo:501: Request processed in 391us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756029.247646:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1784756029.247746:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375ee4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237220480:0@lo:501: 00000100:00100000:0.0:1784756029.247790:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346763b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237220608:0@lo:503: 00000100:00100000:0.0:1784756029.247847:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756029.247871:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff891342e77180 going to sleep for 11 seconds 00000100:00100000:1.0:1784756029.247922:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237220608 00000100:00100000:1.0:1784756029.247926:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237220608 00000100:00100000:1.0:1784756029.247957:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1784756029.247964:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+14:5772:x1871452237220608:12345-0@lo:503: 00000100:00100000:1.0:1784756029.248227:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+14:5772:x1871452237220608:12345-0@lo:503: Request processed in 263us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756029.248233:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1784756029.248270:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346763b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237220608:0@lo:503: 00000100:00100000:1.0:1784756029.248465:0:7899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a82680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:7899:1871452237220736:0@lo:502: 00000100:00100000:1.0:1784756029.248503:0:7899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756029.248523:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237220736 00000100:00100000:1.0:1784756029.248527:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237220736 00000100:00100000:1.0:1784756029.248545:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1784756029.248551:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+14:7899:x1871452237220736:12345-0@lo:502: 00000100:00100000:1.0:1784756029.248747:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+14:7899:x1871452237220736:12345-0@lo:502: Request processed in 195us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756029.248753:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1784756029.248809:0:7899:0:(client.c:2702:ptlrpc_set_wait()) set ffff891343f15240 going to sleep for 11 seconds 00000100:00100000:1.0:1784756029.248823:0:7899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a82680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:7899:1871452237220736:0@lo:502: 00000100:00100000:1.0:1784756029.248860:0:7899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a82680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:7899:1871452237220864:0@lo:502: 00000100:00100000:1.0:1784756029.248891:0:7899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756029.248908:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237220864 00000100:00100000:1.0:1784756029.248912:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237220864 00000100:00100000:1.0:1784756029.248932:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1784756029.248937:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346888050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+14:7899:x1871452237220864:12345-0@lo:502: 00000100:00100000:1.0:1784756029.249048:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346888050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+14:7899:x1871452237220864:12345-0@lo:502: Request processed in 110us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756029.249055:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1784756029.249096:0:7899:0:(client.c:2702:ptlrpc_set_wait()) set ffff891343f15240 going to sleep for 11 seconds 00000100:00100000:1.0:1784756029.249108:0:7899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a82680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:7899:1871452237220864:0@lo:502: 00000040:00080000:1.0:1784756029.249125:0:7899:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1784756029.249168:0:5772:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1784756029.249185:0:5772:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784756029.249194:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff891382147a00/0xc0f560bd53f8f83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8f8a expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756029.249205:0:5772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff891382147a00/0xc0f560bd53f8f83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8f8a expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784756029.249215:0:5772:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1784756029.249218:0:5772:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1784756029.249221:0:5772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1784756029.249247:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8913429e4c00/0xc0f560bd53f8f91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756029.249265:0:5772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8913429e4c00/0xc0f560bd53f8f91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756029.249274:0:5772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8913429e4c00/0xc0f560bd53f8f91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756029.249286:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237220992:0@lo:101: 00000100:00100000:1.0:1784756029.249312:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756029.249327:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff891343f15240 going to sleep for 11 seconds 00000100:00100000:1.0:1784756029.249337:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237220992 00000100:00100000:1.0:1784756029.249340:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237220992 00000100:00100000:1.0:1784756029.249358:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1784756029.249363:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+14:5772:x1871452237220992:12345-0@lo:101: 00010000:00010000:1.0:1784756029.249371:0:5768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784756029.249383:0:5768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8913429e4a00/0xc0f560bd53f8f98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0f560bd53f8f91 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756029.249402:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8913429e4a00/0xc0f560bd53f8f98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0f560bd53f8f91 expref: 15 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756029.249411:0:5768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8913429e4a00/0xc0f560bd53f8f98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8f91 expref: 15 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756029.249440:0:5768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8913429e4a00, rc 0) 00000100:00100000:1.0:1784756029.249465:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+15:5772:x1871452237220992:12345-0@lo:101: Request processed in 102us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756029.249470:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1784756029.249498:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237220992:0@lo:101: 00010000:00010000:1.0:1784756029.249517:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8913429e4c00/0xc0f560bd53f8f91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8f98 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756029.249525:0:5772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8913429e4c00/0xc0f560bd53f8f91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0f560bd53f8f98 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756029.249559:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237221120:0@lo:501: 00000100:00100000:1.0:1784756029.249584:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756029.249597:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff891343f15240 going to sleep for 11 seconds 00000100:00100000:1.0:1784756029.249607:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237221120 00000100:00100000:1.0:1784756029.249610:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237221120 00000100:00100000:1.0:1784756029.249627:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1784756029.249632:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+15:5772:x1871452237221120:12345-0@lo:501: 00000100:00100000:1.0:1784756029.249839:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+15:5772:x1871452237221120:12345-0@lo:501: Request processed in 207us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756029.249846:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1784756029.249882:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237221120:0@lo:501: 00000100:00100000:1.0:1784756029.249904:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237221248:0@lo:503: 00000100:00100000:1.0:1784756029.249935:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756029.249948:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff891343f15240 going to sleep for 11 seconds 00000100:00100000:1.0:1784756029.249958:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237221248 00000100:00100000:1.0:1784756029.249961:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237221248 00000100:00100000:1.0:1784756029.249980:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1784756029.249986:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+15:5772:x1871452237221248:12345-0@lo:503: 00000100:00100000:1.0:1784756029.250239:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+15:5772:x1871452237221248:12345-0@lo:503: Request processed in 253us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756029.250246:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1784756029.250286:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237221248:0@lo:503: 00000100:00100000:0.0:1784756029.254169:0:7900:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346761880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:7900:1871452237221376:0@lo:502: 00000100:00100000:0.0:1784756029.254259:0:7900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756029.254307:0:7900:0:(client.c:2702:ptlrpc_set_wait()) set ffff891342e77180 going to sleep for 11 seconds 00000100:00100000:1.0:1784756029.254355:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237221376 00000100:00100000:1.0:1784756029.254362:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237221376 00000100:00100000:1.0:1784756029.254438:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1784756029.254448:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+15:7900:x1871452237221376:12345-0@lo:502: 00000100:00100000:1.0:1784756029.254690:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+15:7900:x1871452237221376:12345-0@lo:502: Request processed in 243us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756029.254698:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1784756029.254890:0:7900:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346761880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:7900:1871452237221376:0@lo:502: 00000020:01000000:0.0:1784756029.254919:0:7900:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784756029.254928:0:7900:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784756029.254931:0:7900:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784756029.254935:0:7900:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784756029.254937:0:7900:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1784756029.254953:0:7900:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346761880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:7900:1871452237221504:0@lo:502: 00000100:00100000:0.0:1784756029.254983:0:7900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756029.255005:0:7900:0:(client.c:2702:ptlrpc_set_wait()) set ffff891342e77180 going to sleep for 11 seconds 00000100:00100000:1.0:1784756029.255043:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237221504 00000100:00100000:1.0:1784756029.255048:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237221504 00000100:00100000:1.0:1784756029.255070:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1784756029.255076:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+15:7900:x1871452237221504:12345-0@lo:502: 00000100:00100000:1.0:1784756029.255193:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+15:7900:x1871452237221504:12345-0@lo:502: Request processed in 116us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756029.255200:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1784756029.255259:0:7900:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346761880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:7900:1871452237221504:0@lo:502: 00000020:01000000:0.0:1784756029.255274:0:7900:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784756029.255278:0:7900:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784756029.255279:0:7900:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1784756029.255282:0:7900:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1784756029.255448:0:5772:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1784756029.255467:0:5772:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1784756029.255477:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8913429e4c00/0xc0f560bd53f8f91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8f98 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756029.255488:0:5772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8913429e4c00/0xc0f560bd53f8f91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8f98 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784756029.255498:0:5772:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784756029.255501:0:5772:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8913516af000 from 30 10000000:01000000:1.0:1784756029.255504:0:5772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784756029.255528:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8913429e4200/0xc0f560bd53f8f9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756029.255548:0:5772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8913429e4200/0xc0f560bd53f8f9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756029.255557:0:5772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8913429e4200/0xc0f560bd53f8f9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756029.255570:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237221632:0@lo:101: 00000100:00100000:1.0:1784756029.255601:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756029.255618:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff891343f153c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784756029.255671:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237221632 00000100:00100000:0.0:1784756029.255675:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237221632 00000100:00100000:0.0:1784756029.255703:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1784756029.255710:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+15:5772:x1871452237221632:12345-0@lo:101: 00010000:00010000:0.0:1784756029.255719:0:5768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756029.255731:0:5768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891342baf800/0xc0f560bd53f8fa6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0f560bd53f8f9f expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756029.255761:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891342baf800/0xc0f560bd53f8fa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0f560bd53f8f9f expref: 16 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756029.255772:0:5768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891342baf800/0xc0f560bd53f8fa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8f9f expref: 16 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756029.255782:0:5768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891342baf800, rc 0) 00000100:00100000:0.0:1784756029.255826:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+16:5772:x1871452237221632:12345-0@lo:101: Request processed in 117us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756029.255832:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1784756029.255900:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237221632:0@lo:101: 00010000:00010000:1.0:1784756029.255913:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8913429e4200/0xc0f560bd53f8f9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8fa6 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756029.255921:0:5772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8913429e4200/0xc0f560bd53f8f9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0f560bd53f8fa6 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756029.255962:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237221760:0@lo:501: 00000100:00100000:1.0:1784756029.255984:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756029.256005:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff891343f153c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784756029.256043:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237221760 00000100:00100000:0.0:1784756029.256047:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237221760 00000100:00100000:0.0:1784756029.256073:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1784756029.256079:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346889050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+16:5772:x1871452237221760:12345-0@lo:501: 00000100:00100000:0.0:1784756029.256297:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346889050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+16:5772:x1871452237221760:12345-0@lo:501: Request processed in 216us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756029.256303:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1784756029.256368:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237221760:0@lo:501: 00000100:00100000:1.0:1784756029.256392:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237221888:0@lo:503: 00000100:00100000:1.0:1784756029.256452:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756029.256468:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff891343f153c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784756029.256512:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237221888 00000100:00100000:0.0:1784756029.256516:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237221888 00000100:00100000:0.0:1784756029.256543:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1784756029.256550:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+16:5772:x1871452237221888:12345-0@lo:503: 00000100:00100000:0.0:1784756029.256672:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+16:5772:x1871452237221888:12345-0@lo:503: Request processed in 122us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756029.256678:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1784756029.256745:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237221888:0@lo:503: 00000100:00100000:3.0:1784756029.261009:0:7902:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375ee6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:7902:1871452237222016:0@lo:502: 00000100:00100000:3.0:1784756029.261099:0:7902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756029.261149:0:7902:0:(client.c:2702:ptlrpc_set_wait()) set ffff89136bcaf9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784756029.261239:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237222016 00000100:00100000:0.0:1784756029.261246:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237222016 00000100:00100000:0.0:1784756029.261289:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1784756029.261305:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+16:7902:x1871452237222016:12345-0@lo:502: 00000100:00100000:0.0:1784756029.261579:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+16:7902:x1871452237222016:12345-0@lo:502: Request processed in 275us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756029.261588:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1784756029.261696:0:7902:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375ee6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:7902:1871452237222016:0@lo:502: 00000100:00100000:3.0:1784756029.261743:0:7902:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375ee6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:7902:1871452237222144:0@lo:502: 00000100:00100000:3.0:1784756029.261773:0:7902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756029.261810:0:7902:0:(client.c:2702:ptlrpc_set_wait()) set ffff89136bcaf9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784756029.261849:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237222144 00000100:00100000:0.0:1784756029.261853:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237222144 00000100:00100000:0.0:1784756029.261877:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1784756029.261882:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+16:7902:x1871452237222144:12345-0@lo:502: 00000100:00100000:0.0:1784756029.262010:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+16:7902:x1871452237222144:12345-0@lo:502: Request processed in 127us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756029.262017:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1784756029.262088:0:7902:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375ee6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:7902:1871452237222144:0@lo:502: 00000040:00080000:3.0:1784756029.262106:0:7902:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1784756029.262247:0:5772:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1784756029.262270:0:5772:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784756029.262280:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8913429e4200/0xc0f560bd53f8f9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8fa6 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756029.262291:0:5772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8913429e4200/0xc0f560bd53f8f9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8fa6 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784756029.262301:0:5772:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784756029.262304:0:5772:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8913516af000 from 5 10000000:01000000:0.0:1784756029.262307:0:5772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784756029.262333:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff891342bafa00/0xc0f560bd53f8fad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756029.262340:0:5772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff891342bafa00/0xc0f560bd53f8fad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756029.262349:0:5772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff891342bafa00/0xc0f560bd53f8fad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756029.262370:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346761880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237222272:0@lo:101: 00000100:00100000:0.0:1784756029.262397:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756029.262441:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff891349270540 going to sleep for 11 seconds 00000100:00100000:0.0:1784756029.262454:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237222272 00000100:00100000:0.0:1784756029.262458:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237222272 00000100:00100000:0.0:1784756029.262481:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1784756029.262487:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+16:5772:x1871452237222272:12345-0@lo:101: 00010000:00010000:0.0:1784756029.262496:0:5767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756029.262509:0:5767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891342bae000/0xc0f560bd53f8fb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0f560bd53f8fad expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756029.262531:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891342bae000/0xc0f560bd53f8fb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0f560bd53f8fad expref: 17 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756029.262541:0:5767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891342bae000/0xc0f560bd53f8fb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8fad expref: 17 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756029.262550:0:5767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891342bae000, rc 0) 00000100:00100000:0.0:1784756029.262581:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+17:5772:x1871452237222272:12345-0@lo:101: Request processed in 94us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756029.262587:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1784756029.262668:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346761880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237222272:0@lo:101: 00010000:00010000:3.0:1784756029.262682:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff891342bafa00/0xc0f560bd53f8fad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8fb4 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756029.262690:0:5772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff891342bafa00/0xc0f560bd53f8fad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0f560bd53f8fb4 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756029.262734:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375ee6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237222400:0@lo:256: 00000100:00100000:3.0:1784756029.262763:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756029.262803:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff89136bcaf9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784756029.262984:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237222400 00000100:00100000:0.0:1784756029.262989:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237222400 00000100:00100000:0.0:1784756029.263020:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1784756029.263026:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+17:5772:x1871452237222400:12345-0@lo:256: 20000000:01000000:0.0:1784756029.263039:0:5768:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784756029.263052:0:5768:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784756029.263059:0:5768:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1784756029.263133:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+17:5772:x1871452237222400:12345-0@lo:256: Request processed in 107us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756029.263140:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1784756029.263200:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375ee6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237222400:0@lo:256: 10000000:01000000:3.0:1784756029.263243:0:5772:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784756029.263250:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff891342bafa00/0xc0f560bd53f8fad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8fb4 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756029.263258:0:5772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff891342bafa00/0xc0f560bd53f8fad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8fb4 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784756029.263270:0:5772:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1784756029.263272:0:5772:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1784756029.263274:0:5772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1784756029.263290:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff89134151be00/0xc0f560bd53f8fbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756029.263297:0:5772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff89134151be00/0xc0f560bd53f8fbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756029.263303:0:5772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff89134151be00/0xc0f560bd53f8fbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756029.263314:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375ee6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237222528:0@lo:101: 00000100:00100000:3.0:1784756029.263336:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756029.263358:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff89136bcaf9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784756029.263400:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237222528 00000100:00100000:2.0:1784756029.263404:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237222528 00000100:00100000:2.0:1784756029.263463:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1784756029.263470:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+17:5772:x1871452237222528:12345-0@lo:101: 00010000:00010000:2.0:1784756029.263476:0:6669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756029.263486:0:6669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891382147600/0xc0f560bd53f8fc2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0f560bd53f8fbb expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756029.263502:0:6669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891382147600/0xc0f560bd53f8fc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0f560bd53f8fbb expref: 18 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756029.263511:0:6669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891382147600/0xc0f560bd53f8fc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8fbb expref: 18 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756029.263530:0:6669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891382147600, rc 0) 00000100:00100000:2.0:1784756029.263559:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+18:5772:x1871452237222528:12345-0@lo:101: Request processed in 90us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756029.263566:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1784756029.263673:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375ee6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237222528:0@lo:101: 00010000:00010000:3.0:1784756029.263685:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff89134151be00/0xc0f560bd53f8fbb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8fc2 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756029.263693:0:5772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff89134151be00/0xc0f560bd53f8fbb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0f560bd53f8fc2 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756029.263734:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375ee6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237222656:0@lo:501: 00000100:00100000:3.0:1784756029.263757:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756029.263780:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff89136bcaf9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784756029.263790:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237222656 00000100:00100000:3.0:1784756029.263802:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237222656 00000100:00100000:3.0:1784756029.263822:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1784756029.263835:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+18:5772:x1871452237222656:12345-0@lo:501: 00000100:00100000:3.0:1784756029.264062:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+18:5772:x1871452237222656:12345-0@lo:501: Request processed in 227us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756029.264069:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1784756029.264097:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375ee6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237222656:0@lo:501: 00000100:00100000:3.0:1784756029.264121:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375ee6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237222784:0@lo:503: 00000100:00100000:3.0:1784756029.264155:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756029.264172:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff89136bcaf9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784756029.264182:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237222784 00000100:00100000:3.0:1784756029.264185:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237222784 00000100:00100000:3.0:1784756029.264204:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1784756029.264210:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+18:5772:x1871452237222784:12345-0@lo:503: 00000100:00100000:3.0:1784756029.264526:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+18:5772:x1871452237222784:12345-0@lo:503: Request processed in 314us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756029.264533:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1784756029.264568:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375ee6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237222784:0@lo:503: 00000100:00100000:3.0:1784756029.264733:0:7903:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375ee6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:7903:1871452237222912:0@lo:502: 00000100:00100000:3.0:1784756029.264764:0:7903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756029.264783:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237222912 00000100:00100000:3.0:1784756029.264787:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237222912 00000100:00100000:3.0:1784756029.264821:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1784756029.264827:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+18:7903:x1871452237222912:12345-0@lo:502: 00000100:00100000:3.0:1784756029.265019:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+18:7903:x1871452237222912:12345-0@lo:502: Request processed in 192us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756029.265026:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1784756029.265067:0:7903:0:(client.c:2702:ptlrpc_set_wait()) set ffff89136bcaf480 going to sleep for 11 seconds 00000100:00100000:3.0:1784756029.265079:0:7903:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375ee6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:7903:1871452237222912:0@lo:502: 00000020:01000000:3.0:1784756029.265100:0:7903:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784756029.265108:0:7903:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1784756029.265116:0:7903:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784756029.265118:0:7903:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1784756029.265123:0:7903:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784756029.265127:0:7903:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.141@tcp to nid 0x20000c0a8ca8d (192.168.202.141@tcp) 00000020:01000000:3.0:1784756029.265150:0:7903:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1784756029.265153:0:7903:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784756029.265168:0:7903:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8913467199c0) 00000020:00000080:3.0:1784756029.265186:0:7903:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1784756029.265191:0:7903:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1784756029.265259:0:7903:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1784756029.265266:0:7903:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:3.0:1784756029.265273:0:7903:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc0f560bd53f8fd0 00010000:00080000:3.0:1784756029.265305:0:7903:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89135173a800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.141@tcp at head 00010000:00010000:3.0:1784756029.265577:0:7903:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1784756029.265978:0:7903:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1784756029.265990:0:7903:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1784756029.266547:0:7903:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784756029.266745:0:7903:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784756029.266791:0:7903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1784756029.275008:0:7903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1784756029.275582:0:7904:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784756029.275597:0:7904:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1784756029.281106:0:7903:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784756029.281124:0:7903:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1784756029.282551:0:7903:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1784756029.282586:0:7903:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc0f560bd53f8fd7 00000100:00080000:2.0:1784756029.282601:0:7903:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784756029.282608:0:7903:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89135173a800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1784756029.282652:0:7903:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89134687b800 x1871452237223040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784756029.282687:0:7903:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1784756029.282761:0:7903:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784756029.282766:0:7903:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784756029.282769:0:7903:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1784756029.282772:0:7903:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784756029.282776:0:7903:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784756029.282778:0:7903:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784756029.282780:0:7903:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784756029.282782:0:7903:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1784756029.282850:0:7903:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89134687a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:7903:1871452237223168:0@lo:502: 00000100:00100000:2.0:1784756029.282932:0:7903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756029.282972:0:7903:0:(client.c:2702:ptlrpc_set_wait()) set ffff891347be8840 going to sleep for 11 seconds 00000100:00100000:2.0:1784756029.283048:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237223168 00000100:00100000:2.0:1784756029.283054:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237223168 00000100:00100000:2.0:1784756029.283096:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1784756029.283105:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+18:7903:x1871452237223168:12345-0@lo:502: 00000100:00100000:2.0:1784756029.283350:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+18:7903:x1871452237223168:12345-0@lo:502: Request processed in 245us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756029.283358:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1784756029.283401:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89134687bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3290:1871452237223296:0@lo:400: 00000100:00100000:2.0:1784756029.283456:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756029.283478:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784756029.283484:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3290:1871452237223424:0@lo:400: 00000100:00100000:2.0:1784756029.283505:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756029.283532:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89134687aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237223552:0@lo:400: 00000100:00100000:2.0:1784756029.283557:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756029.283579:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784756029.283584:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89134687ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3292:1871452237223680:0@lo:400: 00000100:00100000:2.0:1784756029.283614:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756029.283647:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237223296 00000100:00100000:2.0:1784756029.283651:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237223296 00000100:00100000:2.0:1784756029.283676:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237223424 00000100:00100000:2.0:1784756029.283678:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237223424 00000100:00100000:2.0:1784756029.283694:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237223680 00000100:00100000:2.0:1784756029.283696:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237223680 00000100:00100000:2.0:1784756029.283708:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784756029.283714:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134687b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1871452237223296:12345-0@lo:400: 00000100:00100000:2.0:1784756029.283746:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134687b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1871452237223296:12345-0@lo:400: Request processed in 32us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756029.283752:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784756029.283764:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784756029.283768:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346878380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1871452237223424:12345-0@lo:400: 00000100:00100000:2.0:1784756029.283788:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346878380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1871452237223424:12345-0@lo:400: Request processed in 20us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756029.283811:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784756029.283823:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784756029.283828:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913585cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1871452237223680:12345-0@lo:400: 00000100:00100000:2.0:1784756029.283856:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913585cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1871452237223680:12345-0@lo:400: Request processed in 28us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756029.283862:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1784756029.283884:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1784756029.283908:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891346878a80 x1871452237223424/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784756045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756029.283921:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3290:1871452237223424:0@lo:400: 00010000:00080000:2.0:1784756029.283931:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89134687bb80 x1871452237223296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784756045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756029.283938:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89134687bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3290:1871452237223296:0@lo:400: 00010000:00080000:2.0:1784756029.283964:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89134687ad80 x1871452237223680/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784756045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756029.283972:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89134687ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3292:1871452237223680:0@lo:400: 00000100:00100000:2.0:1784756029.283988:0:7903:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89134687a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:7903:1871452237223168:0@lo:502: 00000020:01000000:2.0:1784756029.284009:0:7903:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784756029.284015:0:7903:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784756029.284016:0:7903:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1784756029.284020:0:7903:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:3.0:1784756029.284157:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89134687b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3289:1871452237223040:0@lo:8: 00000100:00100000:3.0:1784756029.284202:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756029.284454:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237223552 00000100:00100000:0.0:1784756029.284461:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237223552 00000100:00100000:0.0:1784756029.284518:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237223040 00000100:00100000:0.0:1784756029.284521:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237223040 00000100:00100000:0.0:1784756029.284532:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784756029.284539:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134687a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237223552:12345-0@lo:400: 00000100:00100000:0.0:1784756029.284580:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134687a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237223552:12345-0@lo:400: Request processed in 42us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756029.284586:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784756029.284601:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784756029.284605:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375ee6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3289:x1871452237223040:12345-0@lo:8: 00010000:00080000:0.0:1784756029.284626:0:6575:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 146 last 0 00000020:00000080:0.0:1784756029.284656:0:6575:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc0f560bd53f8fde 00002000:00100000:0.0:1784756029.284672:0:6575:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff89136f9ee800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136b7 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1784756029.284676:0:6575:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1784756029.284680:0:6575:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1784756029.284811:0:6575:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1784756029.284961:0:6575:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784756029.284988:0:6575:0:(import.c:65:import_set_state_nolock()) ffff89137defc000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784756029.285031:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375ee6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3289:x1871452237223040:12345-0@lo:8: Request processed in 423us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756029.285038:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1784756029.285075:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784756029.285103:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89134687aa00 x1871452237223552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756029.285123:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89134687aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237223552:0@lo:400: 00010000:00080000:0.0:1784756029.285156:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89134687b800 x1871452237223040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784756039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756029.285163:0:3289:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784756029.285169:0:3289:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1784756029.285176:0:3289:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784756029.285180:0:3289:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1784756029.285183:0:3289:0:(import.c:65:import_set_state_nolock()) ffff89135173a800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784756029.285193:0:3289:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784756029.285197:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89134687b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3289:1871452237223040:0@lo:8: 00000004:00080000:0.0:1784756029.285280:0:7904:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1784756029.285384:0:7904:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 146961967922ns, next at 0ns, rc = 0 00000020:01000000:0.0:1784756029.286695:0:5772:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1784756029.286723:0:5772:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1784756029.286733:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff89134151be00/0xc0f560bd53f8fbb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8fc2 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756029.286745:0:5772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff89134151be00/0xc0f560bd53f8fbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8fc2 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784756029.286755:0:5772:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1784756029.286758:0:5772:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff891347b0b380 from 1 10000000:01000000:0.0:1784756029.286761:0:5772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784756029.286801:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff891342baea00/0xc0f560bd53f8fe5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756029.286811:0:5772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff891342baea00/0xc0f560bd53f8fe5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756029.286828:0:5772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff891342baea00/0xc0f560bd53f8fe5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756029.286850:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346762a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237223808:0@lo:101: 00000100:00100000:0.0:1784756029.286909:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756029.286949:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff891342e77540 going to sleep for 11 seconds 00000100:00100000:1.0:1784756029.287083:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237223808 00000100:00100000:1.0:1784756029.287089:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237223808 00000100:00100000:1.0:1784756029.287134:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1784756029.287144:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+18:5772:x1871452237223808:12345-0@lo:101: 00010000:00010000:1.0:1784756029.287157:0:5767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784756029.287170:0:5767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8913429e5e00/0xc0f560bd53f8fec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0f560bd53f8fe5 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756029.287192:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8913429e5e00/0xc0f560bd53f8fec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0f560bd53f8fe5 expref: 19 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756029.287203:0:5767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8913429e5e00/0xc0f560bd53f8fec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8fe5 expref: 19 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756029.287212:0:5767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8913429e5e00, rc 0) 00000100:00100000:1.0:1784756029.287254:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+19:5772:x1871452237223808:12345-0@lo:101: Request processed in 111us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756029.287260:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1784756029.287325:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346762a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237223808:0@lo:101: 00010000:00010000:3.0:1784756029.287339:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff891342baea00/0xc0f560bd53f8fe5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8fec expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756029.287358:0:5772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff891342baea00/0xc0f560bd53f8fe5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0f560bd53f8fec expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756029.287408:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375ee4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237223936:0@lo:501: 00000100:00100000:3.0:1784756029.287459:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756029.287483:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff89136bcaf840 going to sleep for 11 seconds 00000100:00100000:0.0:1784756029.287558:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237223936 00000100:00100000:0.0:1784756029.287562:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237223936 00000100:00100000:0.0:1784756029.287629:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1784756029.287637:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+19:5772:x1871452237223936:12345-0@lo:501: 00000100:00100000:0.0:1784756029.287873:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+19:5772:x1871452237223936:12345-0@lo:501: Request processed in 236us (412us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784756029.287880:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1784756029.287942:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375ee4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237223936:0@lo:501: 10000000:01000000:1.0:1784756029.287965:0:5772:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1784756029.287971:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff891342baea00/0xc0f560bd53f8fe5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8fec expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756029.287979:0:5772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff891342baea00/0xc0f560bd53f8fe5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f8fec expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784756029.317647:0:5796:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1784756029.346306:0:7905:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1784756029.346329:0:7905:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346760700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7905:1871452237224192:0@lo:7: 00000100:00100000:0.0:1784756029.346383:0:7905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756029.346404:0:7905:0:(client.c:2702:ptlrpc_set_wait()) set ffff891343f15cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784756029.346436:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346763480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237224064:0@lo:13: 00000100:00100000:0.0:1784756029.346453:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756029.346481:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237224192 00000100:00100000:0.0:1784756029.346486:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237224192 00000100:00100000:0.0:1784756029.346533:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784756029.346542:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7905:x1871452237224192:12345-0@lo:7: 00002000:00080000:0.0:1784756029.349656:0:6575:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1784756029.349663:0:6575:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1784756029.349744:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7905:x1871452237224192:12345-0@lo:7: Request processed in 3199us (3356us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756029.349756:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784756029.350371:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237224064 00000100:00100000:0.0:1784756029.350382:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237224064 00000100:00100000:0.0:1784756029.350445:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784756029.350454:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346761180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3290:x1871452237224064:12345-0@lo:13: 00002000:00000024:0.0:1784756029.350485:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1784756029.350543:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346761180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3290:x1871452237224064:12345-0@lo:13: Request processed in 90us (4087us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756029.350549:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1784756029.350571:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1784756029.350611:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891346763480 x1871452237224064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756045 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756029.350633:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346763480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237224064:0@lo:13: 00010000:00080000:0.0:1784756029.350671:0:7905:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891346760700 x1871452237224192/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784756045 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756029.350681:0:7905:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346760700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7905:1871452237224192:0@lo:7: 00000004:00080000:0.0:1784756029.350691:0:7905:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1784756029.350721:0:7905:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346760700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7905:1871452237224320:0@lo:5: 00000100:00100000:0.0:1784756029.350751:0:7905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756029.350773:0:7905:0:(client.c:2702:ptlrpc_set_wait()) set ffff891381939780 going to sleep for 11 seconds 00000100:00100000:0.0:1784756029.350786:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237224320 00000100:00100000:0.0:1784756029.350790:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237224320 00000100:00100000:0.0:1784756029.350825:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784756029.350832:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346763480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7905:x1871452237224320:12345-0@lo:5: 00002000:00080000:0.0:1784756029.350971:0:6576:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1784756029.350982:0:6576:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1784756029.351339:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346763480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7905:x1871452237224320:12345-0@lo:5: Request processed in 507us (586us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1784756029.351347:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1784756029.351375:0:7905:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891346760700 x1871452237224320/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784756045 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756029.351388:0:7905:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346760700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7905:1871452237224320:0@lo:5: 00000004:00080000:0.0:1784756029.351397:0:7905:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1784756029.351442:0:7905:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346762a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7905:1871452237224448:0@lo:700: 00000100:00100000:0.0:1784756029.351466:0:7905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756029.351484:0:7905:0:(client.c:2702:ptlrpc_set_wait()) set ffff891343f15cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784756029.351562:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237224448 00000100:00100000:0.0:1784756029.351567:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237224448 00000100:00100000:0.0:1784756029.351592:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784756029.351599:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346761880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7905:x1871452237224448:12345-0@lo:700: 00000100:00100000:0.0:1784756029.351627:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346763b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6584:1871452237224576:0@lo:700: 00000100:00100000:0.0:1784756029.351654:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756029.351671:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff891381939780 going to sleep for 11 seconds 00000100:00100000:0.0:1784756029.351685:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237224576 00000100:00100000:0.0:1784756029.351688:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237224576 00000100:00100000:0.0:1784756029.351714:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784756029.351721:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346761500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6584:x1871452237224576:12345-0@lo:700: 40000000:02000000:3.0:1784756029.377617:0:5781:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1784756029.391296:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346761500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6584:x1871452237224576:12345-0@lo:700: Request processed in 39567us (39633us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756029.391310:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1784756029.391575:0:6584:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891346763b80 x1871452237224576/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1784756045 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756029.391606:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346763b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6584:1871452237224576:0@lo:700: 40000000:02000000:1.0:1784756029.391621:0:6584:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:2.0:1784756029.482162:0:7478:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1784756029.482186:0:7478:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1784756029.482399:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346761880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7905:x1871452237224448:12345-0@lo:700: Request processed in 130795us (130927us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756029.482442:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1784756029.482618:0:7905:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891346762a00 x1871452237224448/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1784756045 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756029.482640:0:7905:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1784756029.482657:0:7905:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346762a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7905:1871452237224448:0@lo:700: 00000004:02000040:2.0:1784756029.503646:0:7905:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1784756029.508644:0:7905:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8913585cd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7905:1871452237224704:0@lo:5: 00000100:00100000:2.0:1784756029.508724:0:7905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756029.508857:0:7905:0:(client.c:2702:ptlrpc_set_wait()) set ffff891347be8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784756029.508895:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237224704 00000100:00100000:0.0:1784756029.508904:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237224704 00000100:00100000:0.0:1784756029.508976:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784756029.508986:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913585ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7905:x1871452237224704:12345-0@lo:5: 00002000:00080000:2.0:1784756029.519724:0:6578:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1784756029.519748:0:6578:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1784756029.523039:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913585ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7905:x1871452237224704:12345-0@lo:5: Request processed in 14047us (14307us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1784756029.523053:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1784756029.523230:0:7905:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8913585cd180 x1871452237224704/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784756045 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756029.523249:0:7905:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8913585cd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7905:1871452237224704:0@lo:5: 00000004:00080000:2.0:1784756029.523263:0:7905:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1784756029.811769:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756030.839664:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756031.796733:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784756031.796766:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237224832:0@lo:13: 00000100:00100000:0.0:1784756031.796853:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756031.796946:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237224832 00000100:00100000:0.0:1784756031.796954:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237224832 00000100:00100000:0.0:1784756031.797025:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784756031.797035:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1871452237224832:12345-0@lo:13: 00002000:00000024:0.0:1784756031.797083:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784756031.797146:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1871452237224832:12345-0@lo:13: Request processed in 112us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756031.797154:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1784756031.797182:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784756031.797220:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891346762a00 x1871452237224832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756047 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756031.797241:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237224832:0@lo:13: 00010000:00010000:0.0:1784756031.868091:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784756032.671876:0:7478:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1784756032.885492:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756033.909122:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756034.152537:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1784756034.157857:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228813184 00000100:00100000:1.0:1784756034.157873:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228813184 00000100:00100000:3.0:1784756034.158049:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 111 00000100:00100000:3.0:1784756034.158130:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2350:x1871452228813184:12345-192.168.202.41@tcp:250: 00010000:00080000:3.0:1784756034.158226:0:5768:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 4e891795-8b87-4754-b411-3420f9834f05@192.168.202.41@tcp t0 exp 0000000000000000 cur 151 last 0 00000020:00000080:3.0:1784756034.158259:0:5768:0:(genops.c:1406:class_connect()) connect: client 4e891795-8b87-4754-b411-3420f9834f05, cookie 0xc0f560bd53f8ff3 00000100:00080000:3.0:1784756034.158403:0:5768:0:(import.c:65:import_set_state_nolock()) ffff89136bdb2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784756034.159242:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e891795-8b87-4754-b411-3420f9834f05+5:2350:x1871452228813184:12345-192.168.202.41@tcp:250: Request processed in 1178us (6712us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756034.159254:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 111 00000100:00100000:2.0:1784756034.165989:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1784756034.166491:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228813056 00000100:00100000:0.0:1784756034.166503:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228813056 00000100:00100000:0.0:1784756034.166610:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 112 00000100:00100000:0.0:1784756034.166620:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e891795-8b87-4754-b411-3420f9834f05+5:5551:x1871452228813056:12345-192.168.202.41@tcp:101: 00010000:00010000:0.0:1784756034.166649:0:6669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756034.166669:0:6669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891342bae600/0xc0f560bd53f8ffa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9935e598575abcb expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756034.166700:0:6669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891342bae600/0xc0f560bd53f8ffa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575abcb expref: 6 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756034.166722:0:6669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891342bae600/0xc0f560bd53f8ffa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575abcb expref: 6 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756034.166732:0:6669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891342bae600, rc 0) 00000100:00100000:0.0:1784756034.166852:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e891795-8b87-4754-b411-3420f9834f05+6:5551:x1871452228813056:12345-192.168.202.41@tcp:101: Request processed in 232us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756034.166861:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 112 00000100:00100000:2.0:1784756034.179691:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1784756034.179826:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228813312 00000100:00100000:3.0:1784756034.179837:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228813312 00000100:00100000:3.0:1784756034.179898:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 113 00000100:00100000:3.0:1784756034.179908:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e891795-8b87-4754-b411-3420f9834f05+6:5551:x1871452228813312:12345-192.168.202.41@tcp:501: 00000100:00100000:3.0:1784756034.180768:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e891795-8b87-4754-b411-3420f9834f05+6:5551:x1871452228813312:12345-192.168.202.41@tcp:501: Request processed in 857us (1082us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784756034.180792:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 113 00000100:00100000:3.0:1784756034.190409:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1784756034.191309:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228813440 00000100:00100000:2.0:1784756034.191321:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228813440 00000100:00100000:2.0:1784756034.191446:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 114 00000100:00100000:2.0:1784756034.191457:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e891795-8b87-4754-b411-3420f9834f05+6:5551:x1871452228813440:12345-192.168.202.41@tcp:101: 00010000:00010000:2.0:1784756034.191477:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756034.191499:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891382146600/0xc0f560bd53f9001 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9935e598575abd2 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756034.191532:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891382146600/0xc0f560bd53f9001 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575abd2 expref: 7 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756034.191544:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891382146600/0xc0f560bd53f9001 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575abd2 expref: 7 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756034.191552:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891382146600, rc 0) 00000100:00100000:2.0:1784756034.191633:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e891795-8b87-4754-b411-3420f9834f05+7:5551:x1871452228813440:12345-192.168.202.41@tcp:101: Request processed in 178us (1603us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756034.191650:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 114 00000100:00100000:3.0:1784756034.195086:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1784756034.195900:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228813568 00000100:00100000:0.0:1784756034.195919:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228813568 00000100:00100000:0.0:1784756034.195975:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 115 00000100:00100000:0.0:1784756034.195985:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e891795-8b87-4754-b411-3420f9834f05+7:5551:x1871452228813568:12345-192.168.202.41@tcp:501: 00000100:00100000:0.0:1784756034.201572:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e891795-8b87-4754-b411-3420f9834f05+8:5551:x1871452228813568:12345-192.168.202.41@tcp:501: Request processed in 5574us (6483us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756034.201587:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 115 00000100:00100000:3.0:1784756034.208883:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1784756034.209082:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228813696 00000100:00100000:1.0:1784756034.209093:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228813696 00000100:00100000:1.0:1784756034.209158:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 116 00000100:00100000:1.0:1784756034.209179:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+8:5551:x1871452228813696:12345-192.168.202.41@tcp:503: 00000100:00100000:1.0:1784756034.210129:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+8:5551:x1871452228813696:12345-192.168.202.41@tcp:503: Request processed in 947us (1252us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756034.210140:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 116 00000100:00100000:3.0:1784756034.220343:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1784756034.220528:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228813824 00000100:00100000:2.0:1784756034.220538:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228813824 00000100:00100000:2.0:1784756034.220601:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 117 00000100:00100000:2.0:1784756034.220611:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e891795-8b87-4754-b411-3420f9834f05+8:5571:x1871452228813824:12345-192.168.202.41@tcp:502: 00000100:00100000:2.0:1784756034.221007:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e891795-8b87-4754-b411-3420f9834f05+8:5571:x1871452228813824:12345-192.168.202.41@tcp:502: Request processed in 396us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756034.221016:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 117 00000100:00100000:2.0:1784756034.254097:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1784756034.254208:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228813952 00000100:00100000:0.0:1784756034.254219:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228813952 00000100:00100000:0.0:1784756034.254298:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 118 00000100:00100000:0.0:1784756034.254309:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e891795-8b87-4754-b411-3420f9834f05+8:5571:x1871452228813952:12345-192.168.202.41@tcp:502: 00000100:00100000:0.0:1784756034.254654:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e891795-8b87-4754-b411-3420f9834f05+8:5571:x1871452228813952:12345-192.168.202.41@tcp:502: Request processed in 347us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756034.254663:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 118 00000100:00100000:0.0:1784756034.266154:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1784756034.279911:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228814080 00000100:00100000:2.0:1784756034.279937:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228814080 00000100:00100000:2.0:1784756034.280024:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 119 00000100:00100000:2.0:1784756034.280036:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e891795-8b87-4754-b411-3420f9834f05+8:5551:x1871452228814080:12345-192.168.202.41@tcp:101: 00010000:00010000:2.0:1784756034.280057:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756034.280078:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891382146400/0xc0f560bd53f9008 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9935e598575abfc expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756034.280113:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891382146400/0xc0f560bd53f9008 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575abfc expref: 9 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756034.280249:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891382146400/0xc0f560bd53f9008 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575abfc expref: 9 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756034.280261:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891382146400, rc 0) 00000100:00100000:2.0:1784756034.280342:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e891795-8b87-4754-b411-3420f9834f05+9:5551:x1871452228814080:12345-192.168.202.41@tcp:101: Request processed in 308us (14201us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756034.280370:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 119 00000100:00100000:0.0:1784756034.285913:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1784756034.286021:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228814208 00000100:00100000:1.0:1784756034.286033:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228814208 00000100:00100000:1.0:1784756034.286109:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 120 00000100:00100000:1.0:1784756034.286121:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+9:5551:x1871452228814208:12345-192.168.202.41@tcp:256: 20000000:01000000:1.0:1784756034.286152:0:5767:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1784756034.286177:0:5767:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1784756034.286181:0:5767:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1784756034.286184:0:5767:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1784756034.286187:0:5767:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1784756034.291925:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+9:5551:x1871452228814208:12345-192.168.202.41@tcp:256: Request processed in 5791us (6006us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756034.291943:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 120 00000100:00100000:0.0:1784756034.302994:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1784756034.303112:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228814336 00000100:00100000:2.0:1784756034.303122:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228814336 00000100:00100000:2.0:1784756034.303187:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 121 00000100:00100000:2.0:1784756034.303196:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913466b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e891795-8b87-4754-b411-3420f9834f05+9:5551:x1871452228814336:12345-192.168.202.41@tcp:101: 00010000:00010000:2.0:1784756034.303212:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756034.303230:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891382146e00/0xc0f560bd53f900f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9935e598575ac03 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756034.303262:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891382146e00/0xc0f560bd53f900f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac03 expref: 10 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756034.303273:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891382146e00/0xc0f560bd53f900f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac03 expref: 10 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756034.303283:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891382146e00, rc 0) 00000100:00100000:2.0:1784756034.303352:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913466b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e891795-8b87-4754-b411-3420f9834f05+10:5551:x1871452228814336:12345-192.168.202.41@tcp:101: Request processed in 157us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756034.303359:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 121 00000100:00100000:0.0:1784756034.305167:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1784756034.305285:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228814464 00000100:00100000:2.0:1784756034.305294:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228814464 00000100:00100000:2.0:1784756034.305493:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 122 00000100:00100000:2.0:1784756034.305504:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913466bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e891795-8b87-4754-b411-3420f9834f05+10:5551:x1871452228814464:12345-192.168.202.41@tcp:501: 00000100:00100000:2.0:1784756034.305860:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913466bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e891795-8b87-4754-b411-3420f9834f05+10:5551:x1871452228814464:12345-192.168.202.41@tcp:501: Request processed in 357us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756034.305870:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 122 00000100:00100000:3.0:1784756034.308053:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1784756034.308196:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228814592 00000100:00100000:2.0:1784756034.308219:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228814592 00000100:00100000:2.0:1784756034.308277:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 123 00000100:00100000:2.0:1784756034.308286:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913466b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e891795-8b87-4754-b411-3420f9834f05+10:5551:x1871452228814592:12345-192.168.202.41@tcp:503: 00000100:00100000:2.0:1784756034.308975:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913466b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e891795-8b87-4754-b411-3420f9834f05+10:5551:x1871452228814592:12345-192.168.202.41@tcp:503: Request processed in 687us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756034.308985:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 123 00000100:00100000:0.0:1784756034.316604:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1784756034.316717:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228814720 00000100:00100000:1.0:1784756034.316729:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228814720 00000100:00100000:1.0:1784756034.316798:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 124 00000100:00100000:1.0:1784756034.316808:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913466ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+10:5575:x1871452228814720:12345-192.168.202.41@tcp:502: 00000100:00100000:1.0:1784756034.317072:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913466ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+10:5575:x1871452228814720:12345-192.168.202.41@tcp:502: Request processed in 265us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756034.317081:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 124 00000100:00100000:0.0:1784756034.319245:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1784756034.319512:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228814848 00000100:00100000:2.0:1784756034.319521:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228814848 00000100:00100000:2.0:1784756034.319634:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 125 00000100:00100000:2.0:1784756034.319644:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913466b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e891795-8b87-4754-b411-3420f9834f05+10:5575:x1871452228814848:12345-192.168.202.41@tcp:502: 00000100:00100000:2.0:1784756034.319912:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913466b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e891795-8b87-4754-b411-3420f9834f05+10:5575:x1871452228814848:12345-192.168.202.41@tcp:502: Request processed in 268us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756034.319920:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 125 00000100:00100000:0.0:1784756034.322957:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1784756034.323235:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228814976 00000100:00100000:2.0:1784756034.323246:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228814976 00000100:00100000:2.0:1784756034.323352:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 4 00000100:00100000:2.0:1784756034.323361:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346762a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2350:x1871452228814976:12345-192.168.202.41@tcp:38: 00010000:00080000:2.0:1784756034.323405:0:5775:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 391dd9f2-6bf0-4674-aedd-25845b6bf878@192.168.202.41@tcp t0 exp 0000000000000000 cur 151 last 0 00000020:00000080:2.0:1784756034.323488:0:5775:0:(genops.c:1406:class_connect()) connect: client 391dd9f2-6bf0-4674-aedd-25845b6bf878, cookie 0xc0f560bd53f9016 00000004:00100000:2.0:1784756034.323524:0:5775:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000001:00000004:2.0:1784756034.323531:0:5775:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1784756034.346172:0:5775:0:(import.c:65:import_set_state_nolock()) ffff89136f4f7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784756034.346824:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346762a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2350:x1871452228814976:12345-192.168.202.41@tcp:38: Request processed in 23457us (23870us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756034.346840:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 4 00000100:00100000:2.0:1784756034.355836:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784756034.355882:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8913585cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1871452237224960:0@lo:13: 00000100:00100000:2.0:1784756034.355946:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756034.356728:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346763100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237225472:0@lo:400: 00000100:00100000:3.0:1784756034.356776:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756034.356800:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784756034.356806:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346760000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a5739ad-a70a-4582-8756-59cdd498af45:3292:1871452237225088:0@lo:400: 00000100:00100000:3.0:1784756034.356829:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756034.356851:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346761f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3292:1871452237225600:0@lo:400: 00000100:00100000:3.0:1784756034.356871:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756034.357800:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237224960 00000100:00100000:0.0:1784756034.357811:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237224960 00000100:00100000:0.0:1784756034.357876:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784756034.357884:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913585cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1871452237224960:12345-0@lo:13: 00002000:00000024:0.0:1784756034.357919:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784756034.357969:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913585cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1871452237224960:12345-0@lo:13: Request processed in 85us (2022us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756034.357975:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784756034.358002:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346760380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3290:1871452237225216:0@lo:400: 00000100:00100000:0.0:1784756034.358032:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756034.358054:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784756034.358059:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346760e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3290:1871452237225344:0@lo:400: 00000100:00080000:3.0:1784756034.358369:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784756034.358519:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237225600 00000100:00100000:2.0:1784756034.358525:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237225600 00000100:00100000:2.0:1784756034.358575:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237225216 00000100:00100000:2.0:1784756034.358577:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237225216 00000100:00100000:2.0:1784756034.358594:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784756034.358600:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1871452237225600:12345-0@lo:400: 00000100:00100000:1.0:1784756034.358848:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784756034.358858:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346763b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1871452237225216:12345-0@lo:400: 00000100:00100000:1.0:1784756034.358893:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346763b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1871452237225216:12345-0@lo:400: Request processed in 38us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756034.358899:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1784756034.358992:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784756034.359109:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1784756034.359145:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891346760380 x1871452237225216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784756050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756034.359177:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346760380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3290:1871452237225216:0@lo:400: 00000100:00100000:0.0:1784756034.359205:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237225472 00000100:00100000:0.0:1784756034.359208:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237225472 00000100:00100000:0.0:1784756034.359253:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784756034.359258:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237225472:12345-0@lo:400: 00000100:00100000:1.0:1784756034.359315:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237225344 00000100:00100000:1.0:1784756034.359319:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237225344 00000100:00100000:1.0:1784756034.359337:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784756034.359342:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1871452237225344:12345-0@lo:400: 00000100:00100000:1.0:1784756034.359371:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1871452237225344:12345-0@lo:400: Request processed in 29us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756034.359377:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1784756034.359401:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891346760e00 x1871452237225344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784756050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756034.359410:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346760e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3290:1871452237225344:0@lo:400: 00000100:00100000:2.0:1784756034.359484:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1871452237225600:12345-0@lo:400: Request processed in 884us (2611us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756034.359491:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1784756034.359518:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8913585cfb80 x1871452237224960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756050 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756034.359526:0:3293:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1784756034.359541:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8913585cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1871452237224960:0@lo:13: 00000100:00100000:2.0:1784756034.359571:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237225088 00000100:00100000:2.0:1784756034.359573:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237225088 00000100:00100000:2.0:1784756034.359599:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1784756034.359605:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913466bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+19:3292:x1871452237225088:12345-0@lo:400: 00000100:00100000:2.0:1784756034.360334:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913466bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+19:3292:x1871452237225088:12345-0@lo:400: Request processed in 726us (3500us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756034.360342:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1784756034.360472:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237225472:12345-0@lo:400: Request processed in 1154us (3637us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756034.360480:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1784756034.360503:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784756034.360507:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784756034.360783:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891346761f80 x1871452237225600/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784756050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756034.360796:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346761f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3292:1871452237225600:0@lo:400: 00010000:00080000:2.0:1784756034.360889:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891346763100 x1871452237225472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756034.360898:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346763100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237225472:0@lo:400: 00000100:00100000:2.0:1784756034.360917:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346760000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a5739ad-a70a-4582-8756-59cdd498af45:3292:1871452237225088:0@lo:400: 00000100:00100000:0.0:1784756034.850923:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1784756034.850975:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1784756034.851494:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228815232 00000100:00100000:2.0:1784756034.851506:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228815232 00000100:00100000:2.0:1784756034.851585:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228815104 00000100:00100000:2.0:1784756034.851589:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228815104 00000100:00100000:2.0:1784756034.851618:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 5 00000100:00100000:2.0:1784756034.851630:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:391dd9f2-6bf0-4674-aedd-25845b6bf878+7:5551:x1871452228815232:12345-192.168.202.41@tcp:41: 00000004:00000024:2.0:1784756034.851678:0:6599:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1784756034.851756:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:391dd9f2-6bf0-4674-aedd-25845b6bf878+7:5551:x1871452228815232:12345-192.168.202.41@tcp:41: Request processed in 128us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756034.851763:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 5 00000100:00100000:2.0:1784756034.851780:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 6 00000100:00100000:2.0:1784756034.851787:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:0:x1871452228815104:12345-192.168.202.41@tcp:41: 00000004:00000024:2.0:1784756034.851804:0:6599:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1784756034.851827:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:0:x1871452228815104:12345-192.168.202.41@tcp:41: Request processed in 41us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756034.851834:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 6 00000100:00080000:0.0:1784756034.852268:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784756034.856958:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1784756034.857168:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228815360 00000100:00100000:2.0:1784756034.857178:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228815360 00000100:00100000:2.0:1784756034.857292:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:2.0:1784756034.857305:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f415f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:5551:x1871452228815360:12345-192.168.202.41@tcp:40: 00000100:00100000:2.0:1784756034.857447:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f415f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:5551:x1871452228815360:12345-192.168.202.41@tcp:40: Request processed in 144us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756034.857455:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:0.0:1784756034.861459:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1784756034.861500:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1784756034.861554:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1784756034.861585:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228815488 00000100:00100000:0.0:1784756034.861595:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228815488 00000100:00100000:0.0:1784756034.861628:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228815616 00000100:00100000:0.0:1784756034.861631:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228815616 00000100:00100000:0.0:1784756034.861643:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 8 00000100:00100000:0.0:1784756034.861651:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f417100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1871452228815488:12345-192.168.202.41@tcp:8: 00010000:00080000:0.0:1784756034.861682:0:6575:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 391dd9f2-6bf0-4674-aedd-25845b6bf878@192.168.202.41@tcp t0 exp 0000000000000000 cur 152 last 0 00000020:00000080:0.0:1784756034.861716:0:6575:0:(genops.c:1406:class_connect()) connect: client 391dd9f2-6bf0-4674-aedd-25845b6bf878, cookie 0xc0f560bd53f901d 00002000:00100000:0.0:1784756034.861730:0:6575:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 391dd9f2-6bf0-4674-aedd-25845b6bf878/ffff89136f52b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136b7 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784756034.861779:0:6575:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:0.0:1784756034.862081:0:6575:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1784756034.862113:0:6575:0:(import.c:65:import_set_state_nolock()) ffff89136f52c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784756034.862175:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f417100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2350:x1871452228815488:12345-192.168.202.41@tcp:8: Request processed in 523us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756034.862183:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 8 00000100:00100000:0.0:1784756034.862204:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 9 00000100:00100000:0.0:1784756034.862209:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f414000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1871452228815616:12345-192.168.202.41@tcp:8: 00010000:00080000:0.0:1784756034.862224:0:6575:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 391dd9f2-6bf0-4674-aedd-25845b6bf878@192.168.202.41@tcp t0 exp 0000000000000000 cur 152 last 0 00000020:00000080:0.0:1784756034.862242:0:6575:0:(genops.c:1406:class_connect()) connect: client 391dd9f2-6bf0-4674-aedd-25845b6bf878, cookie 0xc0f560bd53f9024 00002000:00100000:0.0:1784756034.862248:0:6575:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 391dd9f2-6bf0-4674-aedd-25845b6bf878/ffff89137deff800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136b7 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784756034.862254:0:6575:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:0.0:1784756034.862505:0:6575:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784756034.862520:0:6575:0:(import.c:65:import_set_state_nolock()) ffff89137def9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784756034.862547:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f414000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2350:x1871452228815616:12345-192.168.202.41@tcp:8: Request processed in 336us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756034.862554:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 9 00000100:00100000:1.0:1784756034.863350:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228815744 00000100:00100000:1.0:1784756034.863359:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228815744 00000100:00100000:1.0:1784756034.863450:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 0 00000100:00100000:1.0:1784756034.863460:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:5551:x1871452228815744:12345-192.168.202.41@tcp:33: 00000004:00080000:1.0:1784756034.881208:0:5777:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 17677us 00000004:00200000:3.0:1784756034.888507:0:5777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1784756034.888712:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:5551:x1871452228815744:12345-192.168.202.41@tcp:33: Request processed in 25244us (27254us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756034.888728:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 0 00010000:00010000:0.0:1784756034.933093:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756035.139349:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1784756035.139502:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228815872 00000100:00100000:3.0:1784756035.139513:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228815872 00000100:00100000:3.0:1784756035.139579:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 8 00000100:00100000:3.0:1784756035.139590:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:5592:x1871452228815872:12345-192.168.202.41@tcp:101: 00010000:00010000:3.0:1784756035.139626:0:5775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784756035.139706:0:5775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89134151aa00/0xc0f560bd53f902b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9935e598575ac2d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756035.139801:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89134151ac00/0xc0f560bd53f9032 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756035.139816:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89134151ac00/0xc0f560bd53f9032 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756035.139831:0:5775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89134151ac00/0xc0f560bd53f9032 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784756035.140019:0:5775:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1784756035.140024:0:5775:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1784756035.140094:0:5775:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89134151ac00/0xc0f560bd53f9032 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756035.140123:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89134151aa00/0xc0f560bd53f902b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac2d expref: 8 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756035.140140:0:5775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89134151ac00/0xc0f560bd53f9032 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac2d expref: 7 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756035.140149:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891359d6d100) 00010000:00010000:3.0:1784756035.140152:0:5775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784756035.140155:0:5775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89134151ac00, rc 0) 00000100:00100000:3.0:1784756035.140230:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:391dd9f2-6bf0-4674-aedd-25845b6bf878+7:5592:x1871452228815872:12345-192.168.202.41@tcp:101: Request processed in 641us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756035.140238:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 8 00010000:00010000:0.0:1784756035.958215:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756036.915886:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784756036.915911:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3291:1871452237225728:0@lo:13: 00000100:00100000:1.0:1784756036.915985:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756036.916030:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237225728 00000100:00100000:2.0:1784756036.916040:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237225728 00000100:00100000:2.0:1784756036.916103:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784756036.916127:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1871452237225728:12345-0@lo:13: 00002000:00000024:2.0:1784756036.916176:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1784756036.916182:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784756036.916236:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1871452237225728:12345-0@lo:13: Request processed in 110us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756036.916244:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1784756036.916386:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891375a82680 x1871452237225728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756052 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756036.916435:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3291:1871452237225728:0@lo:13: 00000001:00100000:2.0:1784756036.964258:0:6601:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 391dd9f2-6bf0-4674-aedd-25845b6bf878 00010000:00010000:3.0:1784756036.979678:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756037.115802:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1784756037.116014:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228816000 00000100:00100000:1.0:1784756037.116023:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228816000 00000100:00100000:1.0:1784756037.116098:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 9 00000100:00100000:1.0:1784756037.116109:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:391dd9f2-6bf0-4674-aedd-25845b6bf878+7:5644:x1871452228816000:12345-192.168.202.41@tcp:41: 00000004:00000024:1.0:1784756037.116160:0:5776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1784756037.116229:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:391dd9f2-6bf0-4674-aedd-25845b6bf878+7:5644:x1871452228816000:12345-192.168.202.41@tcp:41: Request processed in 122us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756037.116236:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 9 00000100:00080000:3.0:1784756037.116288:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784756037.120887:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1784756037.120993:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228816128 00000100:00100000:2.0:1784756037.121003:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228816128 00000100:00100000:2.0:1784756037.121086:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 9 00000100:00100000:2.0:1784756037.121096:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:391dd9f2-6bf0-4674-aedd-25845b6bf878+5:5644:x1871452228816128:12345-192.168.202.41@tcp:13: 00002000:00000024:2.0:1784756037.121127:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756037.121199:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:391dd9f2-6bf0-4674-aedd-25845b6bf878+5:5644:x1871452228816128:12345-192.168.202.41@tcp:13: Request processed in 104us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756037.121207:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 9 00000100:00080000:3.0:1784756037.121482:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784756037.126869:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1784756037.126976:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228816256 00000100:00100000:2.0:1784756037.126985:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228816256 00000100:00100000:2.0:1784756037.127103:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 10 00000100:00100000:2.0:1784756037.127115:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f414a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:5644:x1871452228816256:12345-192.168.202.41@tcp:13: 00002000:00000024:2.0:1784756037.127159:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756037.127234:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f414a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:5644:x1871452228816256:12345-192.168.202.41@tcp:13: Request processed in 121us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756037.127252:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 10 00000100:00080000:3.0:1784756037.127789:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1784756038.013785:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756039.029631:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1784756039.072651:0:7478:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 391dd9f2-6bf0-4674-aedd-25845b6bf878 00000100:00100000:2.0:1784756039.476139:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237226240:0@lo:400: 00000100:00100000:2.0:1784756039.476206:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756039.476273:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1784756039.476279:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a5739ad-a70a-4582-8756-59cdd498af45:3290:1871452237225856:0@lo:400: 00000100:00100000:2.0:1784756039.476306:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756039.476330:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3290:1871452237226368:0@lo:400: 00000100:00100000:2.0:1784756039.476353:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756039.476380:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3292:1871452237225984:0@lo:400: 00000100:00100000:2.0:1784756039.476401:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756039.476458:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237226496:0@lo:400: 00000100:00100000:2.0:1784756039.476482:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756039.476500:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784756039.476505:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3292:1871452237226112:0@lo:400: 00000100:00100000:2.0:1784756039.476527:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756039.476560:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237226240 00000100:00100000:2.0:1784756039.476566:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237226240 00000100:00100000:2.0:1784756039.476613:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237226496 00000100:00100000:2.0:1784756039.476616:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237226496 00000100:00100000:2.0:1784756039.476635:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784756039.476643:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913585cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3290:x1871452237226240:12345-0@lo:400: 00000100:00100000:2.0:1784756039.476692:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913585cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3290:x1871452237226240:12345-0@lo:400: Request processed in 50us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756039.476699:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784756039.476728:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784756039.476735:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913585cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237226496:12345-0@lo:400: 00000100:00100000:2.0:1784756039.476767:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913585cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237226496:12345-0@lo:400: Request processed in 33us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756039.476773:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784756039.476789:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237225856 00000100:00100000:2.0:1784756039.476798:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237225856 00000100:00100000:2.0:1784756039.476826:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1784756039.476831:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913466b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+19:3290:x1871452237225856:12345-0@lo:400: 00000100:00100000:2.0:1784756039.476870:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913466b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+19:3290:x1871452237225856:12345-0@lo:400: Request processed in 39us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756039.476876:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1784756039.476902:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237226368 00000100:00100000:2.0:1784756039.476906:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237226368 00000100:00100000:2.0:1784756039.476932:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237225984 00000100:00100000:2.0:1784756039.476934:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237225984 00000100:00100000:2.0:1784756039.476945:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237226112 00000100:00100000:2.0:1784756039.476947:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237226112 00000100:00100000:2.0:1784756039.476960:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784756039.476966:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913585cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1871452237226368:12345-0@lo:400: 00000100:00100000:2.0:1784756039.476996:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913585cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1871452237226368:12345-0@lo:400: Request processed in 31us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756039.477002:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784756039.477013:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784756039.477018:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913585cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1871452237225984:12345-0@lo:400: 00000100:00100000:2.0:1784756039.477044:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913585cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1871452237225984:12345-0@lo:400: Request processed in 26us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756039.477050:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784756039.477060:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784756039.477065:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913585cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1871452237226112:12345-0@lo:400: 00000100:00100000:2.0:1784756039.477090:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913585cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1871452237226112:12345-0@lo:400: Request processed in 25us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756039.477096:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1784756039.477151:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784756039.477156:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784756039.477157:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784756039.477175:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8913585cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1871452237226624:0@lo:13: 00000100:00100000:2.0:1784756039.477204:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756039.477233:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237226624 00000100:00100000:2.0:1784756039.477236:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237226624 00000100:00100000:2.0:1784756039.477260:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784756039.477266:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913585cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1871452237226624:12345-0@lo:13: 00002000:00000024:2.0:1784756039.477290:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756039.477325:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913585cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1871452237226624:12345-0@lo:13: Request processed in 60us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756039.477331:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1784756039.477369:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8913585cc380 x1871452237226624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756055 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756039.477387:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8913585cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1871452237226624:0@lo:13: 00000100:00100000:2.0:1784756039.477440:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3292:1871452237226112:0@lo:400: 00000100:00100000:2.0:1784756039.477452:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3292:1871452237225984:0@lo:400: 00010000:00080000:2.0:1784756039.477459:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891375a82d80 x1871452237226496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756039.477467:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237226496:0@lo:400: 00000100:00100000:2.0:1784756039.477495:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a5739ad-a70a-4582-8756-59cdd498af45:3290:1871452237225856:0@lo:400: 00000100:00100000:2.0:1784756039.477505:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3290:1871452237226368:0@lo:400: 00010000:00080000:2.0:1784756039.477515:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891375a82a00 x1871452237226240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756039.477529:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237226240:0@lo:400: 00000001:00100000:0.0:1784756039.572130:0:5796:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 391dd9f2-6bf0-4674-aedd-25845b6bf878 00000001:02000400:2.0:1784756039.897267:0:8131:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1784756040.051786:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756040.228226:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1784756040.228292:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1784756040.228342:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1784756040.228378:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1784756040.228652:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228816512 00000100:00100000:3.0:1784756040.228662:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228816512 00000100:00100000:3.0:1784756040.228751:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00100000:3.0:1784756040.228762:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f416300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2354:x1871452228816512:12345-192.168.202.41@tcp:400: 00000100:00100000:3.0:1784756040.228848:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f416300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2354:x1871452228816512:12345-192.168.202.41@tcp:400: Request processed in 87us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756040.228856:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00080000:0.0:1784756040.228926:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784756040.229347:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228816384 00000100:00100000:1.0:1784756040.229354:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228816384 00000100:00100000:2.0:1784756040.229448:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228816640 00000100:00100000:2.0:1784756040.229452:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228816640 00000100:00100000:2.0:1784756040.229488:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228816768 00000100:00100000:2.0:1784756040.229491:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228816768 00000100:00100000:2.0:1784756040.229509:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 8 00000100:00100000:2.0:1784756040.229516:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f415180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+5:2354:x1871452228816640:12345-192.168.202.41@tcp:400: 00000100:00100000:2.0:1784756040.229572:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f415180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+5:2354:x1871452228816640:12345-192.168.202.41@tcp:400: Request processed in 55us (1279us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756040.229582:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 8 00000100:00100000:2.0:1784756040.229596:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 9 00000100:00100000:2.0:1784756040.229601:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f417b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+5:2354:x1871452228816768:12345-192.168.202.41@tcp:400: 00000100:00100000:0.0:1784756040.229622:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 128 00000100:00100000:2.0:1784756040.229627:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f417b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+5:2354:x1871452228816768:12345-192.168.202.41@tcp:400: Request processed in 26us (1249us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756040.229629:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347ad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+10:2354:x1871452228816384:12345-192.168.202.41@tcp:400: 00000100:00100000:2.0:1784756040.229633:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 9 00000100:00100000:0.0:1784756040.229652:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347ad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+10:2354:x1871452228816384:12345-192.168.202.41@tcp:400: Request processed in 23us (1439us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756040.229658:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 128 00000100:00080000:1.0:1784756040.229722:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784756040.229725:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784756041.075994:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756042.037888:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784756042.037913:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3291:1871452237226752:0@lo:13: 00000100:00100000:1.0:1784756042.037982:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756042.041811:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237226752 00000100:00100000:0.0:1784756042.041826:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237226752 00000100:00100000:0.0:1784756042.041894:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784756042.041903:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375a83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1871452237226752:12345-0@lo:13: 00002000:00000024:0.0:1784756042.041942:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784756042.042025:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375a83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1871452237226752:12345-0@lo:13: Request processed in 124us (4043us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756042.042032:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1784756042.042460:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784756042.042496:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891375a81500 x1871452237226752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756058 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756042.042517:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3291:1871452237226752:0@lo:13: 00010000:00010000:0.0:1784756042.099771:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756043.128102:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784756043.453100:0:8279:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff091fa880 20000000:00000080:1.0:1784756043.453118:0:8279:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff89136c5e8800 uarg=0000000000000000 20000000:01000000:1.0:1784756043.453156:0:8279:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1784756043.453165:0:8279:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1784756043.453168:0:8279:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1784756043.453172:0:8279:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1784756043.453177:0:8279:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1784756043.453191:0:8279:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1784756043.453194:0:8279:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1784756043.453587:0:8279:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1784756043.453590:0:8279:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1784756043.454630:0:8280:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1784756043.455051:0:8279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1784756043.455116:0:8279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1784756043.455155:0:8279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:1.0:1784756043.455165:0:8279:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1784756043.455167:0:8279:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1784756043.455773:0:8281:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1784756043.456087:0:8279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1784756043.456143:0:8279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1784756043.456182:0:8279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1784756043.456193:0:8279:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1784756043.456195:0:8279:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1784756043.457027:0:8282:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1784756043.457321:0:8279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1784756043.457366:0:8279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1784756043.457401:0:8279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1784756043.457684:0:8279:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1784756043.457687:0:8279:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1784756043.458288:0:8283:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1784756043.458787:0:8279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1784756043.458818:0:8279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1784756043.458837:0:8279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:1.0:1784756043.458848:0:8279:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1784756043.458867:0:8279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89135fc59c00/0xc0f560bd53f9039 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756043.458882:0:8279:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8913429e5600/0xc0f560bd53f8f36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8f2f expref: 18 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756043.458887:0:8279:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891382147c00/0xc0f560bd53f8f60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8f59 expref: 18 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756043.458897:0:8279:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8913429e4000/0xc0f560bd53f8f8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8f83 expref: 18 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756043.458972:0:8279:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8913429e4a00/0xc0f560bd53f8f98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8f91 expref: 18 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756043.458980:0:8279:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891342baf800/0xc0f560bd53f8fa6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8f9f expref: 18 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756043.458986:0:8279:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891382147600/0xc0f560bd53f8fc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8fbb expref: 18 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756043.458994:0:8279:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8913429e5e00/0xc0f560bd53f8fec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8fe5 expref: 18 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756043.459004:0:8279:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891342bae600/0xc0f560bd53f8ffa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575abcb expref: 9 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756043.459011:0:8279:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891382146600/0xc0f560bd53f9001 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575abd2 expref: 9 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756043.459018:0:8279:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89135fc59c00/0xc0f560bd53f9039 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756043.459059:0:8279:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891382146600/0xc0f560bd53f9001 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0xf9935e598575abd2 expref: 9 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756043.459073:0:8279:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff891382146600/0xc0f560bd53f9001 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0xf9935e598575abd2 expref: 9 pid: 5769 timeout: 261 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756043.459092:0:8279:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a81500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8279:1871452237226880:192.168.202.41@tcp:104: 00010000:00010000:1.0:1784756043.459229:0:8279:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891342bae600/0xc0f560bd53f8ffa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0xf9935e598575abcb expref: 9 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756043.459235:0:8279:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff891342bae600/0xc0f560bd53f8ffa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0xf9935e598575abcb expref: 9 pid: 6669 timeout: 261 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756043.459241:0:8279:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a81880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8279:1871452237227008:192.168.202.41@tcp:104: 00010000:00010000:1.0:1784756043.459267:0:8279:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8913429e5e00/0xc0f560bd53f8fec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0f560bd53f8fe5 expref: 18 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756043.459275:0:8279:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8913429e5e00/0xc0f560bd53f8fec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0f560bd53f8fe5 expref: 18 pid: 5767 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756043.459284:0:8279:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a80380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8279:1871452237227136:0@lo:104: 00000100:00100000:1.0:1784756043.459324:0:8279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784756043.459360:0:8279:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891382147600/0xc0f560bd53f8fc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0f560bd53f8fbb expref: 18 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756043.459365:0:8279:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff891382147600/0xc0f560bd53f8fc2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0f560bd53f8fbb expref: 18 pid: 6669 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756043.459371:0:8279:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a83800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8279:1871452237227264:0@lo:104: 00000100:00100000:1.0:1784756043.459385:0:8279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784756043.459401:0:8279:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891342baf800/0xc0f560bd53f8fa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0f560bd53f8f9f expref: 18 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756043.459435:0:8279:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff891342baf800/0xc0f560bd53f8fa6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0f560bd53f8f9f expref: 18 pid: 5768 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756043.459452:0:8279:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a82a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8279:1871452237227392:0@lo:104: 00010000:00010000:1.0:1784756043.459479:0:8279:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8913429e4a00/0xc0f560bd53f8f98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0f560bd53f8f91 expref: 18 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756043.459487:0:8279:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8913429e4a00/0xc0f560bd53f8f98 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0f560bd53f8f91 expref: 18 pid: 5768 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756043.459495:0:8279:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a81f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8279:1871452237227520:0@lo:104: 00010000:00010000:1.0:1784756043.459516:0:8279:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8913429e4000/0xc0f560bd53f8f8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0f560bd53f8f83 expref: 18 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756043.459524:0:8279:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8913429e4000/0xc0f560bd53f8f8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0f560bd53f8f83 expref: 18 pid: 6669 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756043.459531:0:8279:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a82300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8279:1871452237227648:0@lo:104: 00010000:00010000:1.0:1784756043.459553:0:8279:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891382147c00/0xc0f560bd53f8f60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0f560bd53f8f59 expref: 18 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756043.459560:0:8279:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff891382147c00/0xc0f560bd53f8f60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0f560bd53f8f59 expref: 18 pid: 5768 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756043.459566:0:8279:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a82d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8279:1871452237227776:0@lo:104: 00010000:00010000:1.0:1784756043.459587:0:8279:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8913429e5600/0xc0f560bd53f8f36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0f560bd53f8f2f expref: 18 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756043.459595:0:8279:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8913429e5600/0xc0f560bd53f8f36 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0f560bd53f8f2f expref: 18 pid: 5768 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756043.459613:0:8279:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a80000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8279:1871452237227904:0@lo:104: 00000100:00100000:1.0:1784756043.459632:0:8279:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913754e4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784756043.459717:0:5757:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1784756043.459736:0:5757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756043.459750:0:5757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756043.459758:0:5757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756043.459765:0:5757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756043.459773:0:5757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756043.459781:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237227136 00000100:00100000:2.0:1784756043.459793:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237227136 00000100:00100000:2.0:1784756043.459827:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237227264 00000100:00100000:2.0:1784756043.459829:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237227264 00000100:00100000:2.0:1784756043.459836:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237227392 00000100:00100000:2.0:1784756043.459838:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237227392 00000100:00100000:2.0:1784756043.459845:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237227520 00000100:00100000:2.0:1784756043.459846:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237227520 00000100:00100000:2.0:1784756043.459852:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237227648 00000100:00100000:2.0:1784756043.459854:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237227648 00000100:00100000:2.0:1784756043.459861:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237227776 00000100:00100000:2.0:1784756043.459863:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237227776 00000100:00100000:2.0:1784756043.459870:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237227904 00000100:00100000:2.0:1784756043.459873:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237227904 00000100:00100000:2.0:1784756043.459885:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784756043.459894:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375a80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3a5739ad-a70a-4582-8756-59cdd498af45+9:8279:x1871452237227136:12345-0@lo:104: 00010000:00010000:2.0:1784756043.460280:0:5757:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff891342baea00/0xc0f560bd53f8fe5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f8fec expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.460358:0:5757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784756043.460366:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375a80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3a5739ad-a70a-4582-8756-59cdd498af45+9:8279:x1871452237227136:12345-0@lo:104: Request processed in 472us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756043.460374:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784756043.460393:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784756043.460401:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f3d5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3a5739ad-a70a-4582-8756-59cdd498af45+8:8279:x1871452237227264:12345-0@lo:104: 00010000:00010000:2.0:1784756043.460408:0:5757:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff89134151be00/0xc0f560bd53f8fbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f8fc2 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.460469:0:5757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784756043.460473:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f3d5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3a5739ad-a70a-4582-8756-59cdd498af45+8:8279:x1871452237227264:12345-0@lo:104: Request processed in 75us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756043.460479:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784756043.460523:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784756043.460530:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913585cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3a5739ad-a70a-4582-8756-59cdd498af45+7:8279:x1871452237227392:12345-0@lo:104: 00010000:00010000:2.0:1784756043.460538:0:5757:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8913429e4200/0xc0f560bd53f8f9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f8fa6 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.460571:0:5757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1784756043.460576:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913585cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3a5739ad-a70a-4582-8756-59cdd498af45+7:8279:x1871452237227392:12345-0@lo:104: Request processed in 48us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756043.460582:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784756043.460593:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784756043.460599:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913585cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3a5739ad-a70a-4582-8756-59cdd498af45+6:8279:x1871452237227520:12345-0@lo:104: 00010000:00010000:2.0:1784756043.460606:0:5757:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8913429e4c00/0xc0f560bd53f8f91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f8f98 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.460630:0:5757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1784756043.460635:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913585cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3a5739ad-a70a-4582-8756-59cdd498af45+6:8279:x1871452237227520:12345-0@lo:104: Request processed in 37us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756043.460641:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784756043.460652:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784756043.460658:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913585ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3a5739ad-a70a-4582-8756-59cdd498af45+5:8279:x1871452237227648:12345-0@lo:104: 00010000:00010000:2.0:1784756043.460675:0:5757:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff891382147a00/0xc0f560bd53f8f83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f8f8a expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.460701:0:5757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1784756043.460706:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913585ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3a5739ad-a70a-4582-8756-59cdd498af45+5:8279:x1871452237227648:12345-0@lo:104: Request processed in 49us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756043.460712:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784756043.460723:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784756043.460736:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913585cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3a5739ad-a70a-4582-8756-59cdd498af45+4:8279:x1871452237227776:12345-0@lo:104: 00010000:00010000:2.0:1784756043.460744:0:5757:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff891342bafe00/0xc0f560bd53f8f59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f8f60 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.460771:0:5757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1784756043.460776:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913585cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3a5739ad-a70a-4582-8756-59cdd498af45+4:8279:x1871452237227776:12345-0@lo:104: Request processed in 41us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756043.460781:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784756043.460792:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784756043.460798:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913585cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3a5739ad-a70a-4582-8756-59cdd498af45+3:8279:x1871452237227904:12345-0@lo:104: 00010000:00010000:2.0:1784756043.460805:0:5757:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff891342baf200/0xc0f560bd53f8f2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f8f36 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.460830:0:5757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1784756043.460834:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913585cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3a5739ad-a70a-4582-8756-59cdd498af45+3:8279:x1871452237227904:12345-0@lo:104: Request processed in 37us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756043.460840:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1784756043.460859:0:7465:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1784756043.460864:0:7465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff891342baea00/0xc0f560bd53f8fe5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f8fec expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.460871:0:7465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891342baea00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:2.0:1784756043.460875:0:7465:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff891342baea00/0xc0f560bd53f8fe5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0f560bd53f8fec expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.460883:0:7465:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff891342baea00/0xc0f560bd53f8fe5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0f560bd53f8fec expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784756043.460890:0:7465:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff891342baea00/0xc0f560bd53f8fe5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0f560bd53f8fec expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784756043.461106:0:7465:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784756043.461142:0:7465:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff891342baea00/0xc0f560bd53f8fe5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8fec expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.461149:0:7465:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784756043.461167:0:7465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff891342baea00/0xc0f560bd53f8fe5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8fec expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.461172:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff891342baea00/0xc0f560bd53f8fe5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8fec expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.461183:0:7465:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1784756043.461185:0:7465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff89134151be00/0xc0f560bd53f8fbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f8fc2 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.461188:0:7465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89134151be00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:2.0:1784756043.461190:0:7465:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff89134151be00/0xc0f560bd53f8fbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0f560bd53f8fc2 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.461194:0:7465:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff89134151be00/0xc0f560bd53f8fbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0f560bd53f8fc2 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784756043.461198:0:7465:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff89134151be00/0xc0f560bd53f8fbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0f560bd53f8fc2 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784756043.461201:0:7465:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784756043.461210:0:7465:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff89134151be00/0xc0f560bd53f8fbb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8fc2 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.461212:0:7465:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784756043.461225:0:7465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff89134151be00/0xc0f560bd53f8fbb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8fc2 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.461229:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff89134151be00/0xc0f560bd53f8fbb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8fc2 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.461236:0:7465:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1784756043.461239:0:7465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8913429e4200/0xc0f560bd53f8f9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f8fa6 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.461245:0:7465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8913429e4200 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:2.0:1784756043.461248:0:7465:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8913429e4200/0xc0f560bd53f8f9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0f560bd53f8fa6 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.461254:0:7465:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8913429e4200/0xc0f560bd53f8f9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0f560bd53f8fa6 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784756043.461260:0:7465:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8913429e4200/0xc0f560bd53f8f9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0f560bd53f8fa6 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784756043.461265:0:7465:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784756043.461277:0:7465:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8913429e4200/0xc0f560bd53f8f9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8fa6 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.461283:0:7465:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784756043.461288:0:7465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8913429e4200/0xc0f560bd53f8f9f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8fa6 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.461294:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8913429e4200/0xc0f560bd53f8f9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8fa6 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.461304:0:7465:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1784756043.461315:0:7465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8913429e4c00/0xc0f560bd53f8f91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f8f98 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.461321:0:7465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8913429e4c00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:2.0:1784756043.461323:0:7465:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8913429e4c00/0xc0f560bd53f8f91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0f560bd53f8f98 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.461329:0:7465:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8913429e4c00/0xc0f560bd53f8f91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0f560bd53f8f98 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784756043.461335:0:7465:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8913429e4c00/0xc0f560bd53f8f91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0f560bd53f8f98 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784756043.461341:0:7465:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784756043.461355:0:7465:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8913429e4c00/0xc0f560bd53f8f91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8f98 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.461361:0:7465:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784756043.461366:0:7465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8913429e4c00/0xc0f560bd53f8f91 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8f98 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.461371:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8913429e4c00/0xc0f560bd53f8f91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8f98 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.461379:0:7465:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784756043.461381:0:7465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff891382147a00/0xc0f560bd53f8f83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f8f8a expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.461386:0:7465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891382147a00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:2.0:1784756043.461388:0:7465:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff891382147a00/0xc0f560bd53f8f83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0f560bd53f8f8a expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.461434:0:7465:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff891382147a00/0xc0f560bd53f8f83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0f560bd53f8f8a expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784756043.461441:0:7465:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff891382147a00/0xc0f560bd53f8f83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0f560bd53f8f8a expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784756043.461445:0:7465:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784756043.461459:0:7465:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff891382147a00/0xc0f560bd53f8f83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8f8a expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.461464:0:7465:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784756043.461468:0:7465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff891382147a00/0xc0f560bd53f8f83 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8f8a expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.461474:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff891382147a00/0xc0f560bd53f8f83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8f8a expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.461483:0:7465:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784756043.461485:0:7465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff891342bafe00/0xc0f560bd53f8f59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f8f60 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.461490:0:7465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891342bafe00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:2.0:1784756043.461492:0:7465:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff891342bafe00/0xc0f560bd53f8f59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0f560bd53f8f60 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.461497:0:7465:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff891342bafe00/0xc0f560bd53f8f59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0f560bd53f8f60 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784756043.461502:0:7465:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff891342bafe00/0xc0f560bd53f8f59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0f560bd53f8f60 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784756043.461513:0:7465:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784756043.461527:0:7465:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff891342bafe00/0xc0f560bd53f8f59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8f60 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.461533:0:7465:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784756043.461537:0:7465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff891342bafe00/0xc0f560bd53f8f59 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8f60 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.461542:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff891342bafe00/0xc0f560bd53f8f59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8f60 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.461553:0:7465:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784756043.461556:0:7465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff891342baf200/0xc0f560bd53f8f2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f8f36 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.461562:0:7465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891342baf200 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:2.0:1784756043.461565:0:7465:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff891342baf200/0xc0f560bd53f8f2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0f560bd53f8f36 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.461571:0:7465:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff891342baf200/0xc0f560bd53f8f2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0f560bd53f8f36 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784756043.461576:0:7465:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff891342baf200/0xc0f560bd53f8f2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0f560bd53f8f36 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784756043.461580:0:7465:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784756043.461590:0:7465:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff891342baf200/0xc0f560bd53f8f2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8f36 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.461596:0:7465:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784756043.461605:0:7465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff891342baf200/0xc0f560bd53f8f2f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8f36 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.461610:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff891342baf200/0xc0f560bd53f8f2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8f36 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.461624:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756043.461626:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756043.461628:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756043.461638:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756043.461644:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756043.461676:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8913585cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3a5739ad-a70a-4582-8756-59cdd498af45:3291:1871452237228032:0@lo:103: 00000100:00100000:2.0:1784756043.461718:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756043.461743:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3a5739ad-a70a-4582-8756-59cdd498af45:3291:1871452237228544:0@lo:103: 00000100:00100000:2.0:1784756043.461761:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756043.461777:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784756043.461780:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8913585cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3a5739ad-a70a-4582-8756-59cdd498af45:3291:1871452237228416:0@lo:103: 00000100:00100000:2.0:1784756043.461791:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756043.461805:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8913585cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a5739ad-a70a-4582-8756-59cdd498af45:3292:1871452237228160:0@lo:103: 00000100:00100000:2.0:1784756043.461817:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756043.461826:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89134687b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a5739ad-a70a-4582-8756-59cdd498af45:3292:1871452237228672:0@lo:103: 00000100:00100000:2.0:1784756043.461847:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756043.461856:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1784756043.461859:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8913585ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a5739ad-a70a-4582-8756-59cdd498af45:3292:1871452237228288:0@lo:103: 00000100:00100000:2.0:1784756043.461870:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756043.461874:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89134687aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a5739ad-a70a-4582-8756-59cdd498af45:3292:1871452237228800:0@lo:103: 00000100:00100000:2.0:1784756043.461885:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756043.462047:0:8279:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a80380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8279:1871452237227136:0@lo:104: 00000100:00100000:1.0:1784756043.462053:0:8279:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a83800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8279:1871452237227264:0@lo:104: 00000100:00100000:1.0:1784756043.462058:0:8279:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a82a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8279:1871452237227392:0@lo:104: 00000100:00100000:1.0:1784756043.462062:0:8279:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a81f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8279:1871452237227520:0@lo:104: 00000100:00100000:1.0:1784756043.462066:0:8279:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a82300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8279:1871452237227648:0@lo:104: 00000100:00100000:1.0:1784756043.462069:0:8279:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a82d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8279:1871452237227776:0@lo:104: 00000100:00100000:1.0:1784756043.462073:0:8279:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a80000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8279:1871452237227904:0@lo:104: 00000100:00100000:3.0:1784756043.462182:0:7464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237228032 00000100:00100000:3.0:1784756043.462187:0:7464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237228032 00010000:00010000:3.0:1784756043.462210:0:7464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8913429e5e00/0xc0f560bd53f8fec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f8fe5 expref: 19 pid: 5767 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756043.462223:0:7464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237228544 00000100:00100000:3.0:1784756043.462224:0:7464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237228544 00010000:00010000:3.0:1784756043.462230:0:7464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8913429e4000/0xc0f560bd53f8f8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f8f83 expref: 20 pid: 6669 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756043.462235:0:7464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237228416 00000100:00100000:3.0:1784756043.462241:0:7464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237228416 00010000:00010000:3.0:1784756043.462248:0:7464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8913429e4a00/0xc0f560bd53f8f98 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f8f91 expref: 21 pid: 5768 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756043.462258:0:7464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237228160 00000100:00100000:3.0:1784756043.462260:0:7464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237228160 00010000:00010000:3.0:1784756043.462268:0:7464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891382147600/0xc0f560bd53f8fc2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f8fbb expref: 22 pid: 6669 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756043.462276:0:7464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237228672 00000100:00100000:3.0:1784756043.462278:0:7464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237228672 00010000:00010000:3.0:1784756043.462287:0:7464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891382147c00/0xc0f560bd53f8f60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f8f59 expref: 23 pid: 5768 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756043.462296:0:7464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237228288 00000100:00100000:3.0:1784756043.462299:0:7464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237228288 00010000:00010000:3.0:1784756043.462308:0:7464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891342baf800/0xc0f560bd53f8fa6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f8f9f expref: 24 pid: 5768 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756043.462317:0:7464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237228800 00000100:00100000:3.0:1784756043.462320:0:7464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237228800 00010000:00010000:3.0:1784756043.462328:0:7464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8913429e5600/0xc0f560bd53f8f36 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f8f2f expref: 25 pid: 5768 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756043.462340:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784756043.462346:0:7464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134687a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a5739ad-a70a-4582-8756-59cdd498af45+25:3291:x1871452237228032:12345-0@lo:103: 00010000:00010000:3.0:1784756043.462359:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784756043.462363:0:7464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8913429e5e00/0xc0f560bd53f8fec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f8fe5 expref: 25 pid: 5767 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756043.462370:0:7464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8913429e5e00/0xc0f560bd53f8fec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0f560bd53f8fe5 expref: 25 pid: 5767 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756043.462389:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8913429e5e00/0xc0f560bd53f8fec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0f560bd53f8fe5 expref: 25 pid: 5767 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756043.462399:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784756043.462464:0:7464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134687a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a5739ad-a70a-4582-8756-59cdd498af45+24:3291:x1871452237228032:12345-0@lo:103: Request processed in 118us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756043.462468:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784756043.462481:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784756043.462485:0:7464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134687ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a5739ad-a70a-4582-8756-59cdd498af45+23:3291:x1871452237228544:12345-0@lo:103: 00010000:00010000:3.0:1784756043.462490:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784756043.462493:0:7464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8913429e4000/0xc0f560bd53f8f8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f8f83 expref: 23 pid: 6669 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756043.462498:0:7464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8913429e4000/0xc0f560bd53f8f8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0f560bd53f8f83 expref: 23 pid: 6669 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756043.462504:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8913429e4000/0xc0f560bd53f8f8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0f560bd53f8f83 expref: 23 pid: 6669 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756043.462510:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784756043.462527:0:7464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134687ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a5739ad-a70a-4582-8756-59cdd498af45+22:3291:x1871452237228544:12345-0@lo:103: Request processed in 41us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756043.462532:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784756043.462543:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784756043.462548:0:7464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134687bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a5739ad-a70a-4582-8756-59cdd498af45+21:3291:x1871452237228416:12345-0@lo:103: 00010000:00010000:3.0:1784756043.462555:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784756043.462559:0:7464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8913429e4a00/0xc0f560bd53f8f98 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f8f91 expref: 21 pid: 5768 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756043.462573:0:7464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8913429e4a00/0xc0f560bd53f8f98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0f560bd53f8f91 expref: 21 pid: 5768 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756043.462583:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8913429e4a00/0xc0f560bd53f8f98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0f560bd53f8f91 expref: 21 pid: 5768 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756043.462589:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784756043.462606:0:7464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134687bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a5739ad-a70a-4582-8756-59cdd498af45+20:3291:x1871452237228416:12345-0@lo:103: Request processed in 59us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756043.462610:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784756043.462622:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784756043.462628:0:7464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346878a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a5739ad-a70a-4582-8756-59cdd498af45+19:3292:x1871452237228160:12345-0@lo:103: 00010000:00010000:3.0:1784756043.462635:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784756043.462639:0:7464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891382147600/0xc0f560bd53f8fc2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f8fbb expref: 19 pid: 6669 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756043.462646:0:7464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891382147600/0xc0f560bd53f8fc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0f560bd53f8fbb expref: 19 pid: 6669 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756043.462656:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891382147600/0xc0f560bd53f8fc2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0f560bd53f8fbb expref: 19 pid: 6669 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756043.462675:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784756043.462742:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8913585cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3a5739ad-a70a-4582-8756-59cdd498af45:3291:1871452237228416:0@lo:103: 00000100:00100000:2.0:1784756043.462743:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784756043.462750:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8913585cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3a5739ad-a70a-4582-8756-59cdd498af45:3291:1871452237228032:0@lo:103: 00000100:00100000:2.0:1784756043.462752:0:5759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891353e84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a5739ad-a70a-4582-8756-59cdd498af45+18:3292:x1871452237228672:12345-0@lo:103: 00000100:00100000:1.0:1784756043.462756:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3a5739ad-a70a-4582-8756-59cdd498af45:3291:1871452237228544:0@lo:103: 00010000:00010000:2.0:1784756043.462759:0:5759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784756043.462764:0:5759:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891382147c00/0xc0f560bd53f8f60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f8f59 expref: 18 pid: 5768 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.462772:0:5759:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891382147c00/0xc0f560bd53f8f60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0f560bd53f8f59 expref: 18 pid: 5768 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.462782:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891382147c00/0xc0f560bd53f8f60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0f560bd53f8f59 expref: 18 pid: 5768 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.462790:0:5759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784756043.462892:0:7464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346878a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a5739ad-a70a-4582-8756-59cdd498af45+17:3292:x1871452237228160:12345-0@lo:103: Request processed in 264us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756043.462910:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784756043.462923:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784756043.462929:0:7464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891353e85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a5739ad-a70a-4582-8756-59cdd498af45+16:3292:x1871452237228288:12345-0@lo:103: 00010000:00010000:3.0:1784756043.462941:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784756043.462945:0:7464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891342baf800/0xc0f560bd53f8fa6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f8f9f expref: 16 pid: 5768 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756043.462953:0:7464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891342baf800/0xc0f560bd53f8fa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0f560bd53f8f9f expref: 16 pid: 5768 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756043.462961:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891342baf800/0xc0f560bd53f8fa6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0f560bd53f8f9f expref: 16 pid: 5768 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756043.462971:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784756043.463163:0:5759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891353e84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a5739ad-a70a-4582-8756-59cdd498af45+15:3292:x1871452237228672:12345-0@lo:103: Request processed in 413us (1313us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756043.463170:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784756043.463185:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784756043.463191:0:5759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913469c4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a5739ad-a70a-4582-8756-59cdd498af45+14:3292:x1871452237228800:12345-0@lo:103: 00010000:00010000:2.0:1784756043.463198:0:5759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784756043.463202:0:5759:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8913429e5600/0xc0f560bd53f8f36 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f8f2f expref: 14 pid: 5768 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756043.463215:0:5759:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8913429e5600/0xc0f560bd53f8f36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0f560bd53f8f2f expref: 14 pid: 5768 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756043.463220:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8913585cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a5739ad-a70a-4582-8756-59cdd498af45:3292:1871452237228160:0@lo:103: 00010000:00010000:2.0:1784756043.463224:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8913429e5600/0xc0f560bd53f8f36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0f560bd53f8f2f expref: 14 pid: 5768 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756043.463229:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89134687b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a5739ad-a70a-4582-8756-59cdd498af45:3292:1871452237228672:0@lo:103: 00010000:00010000:2.0:1784756043.463234:0:5759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784756043.464057:0:7464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891353e85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a5739ad-a70a-4582-8756-59cdd498af45+13:3292:x1871452237228288:12345-0@lo:103: Request processed in 1125us (2181us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756043.464067:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784756043.464121:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8913585ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a5739ad-a70a-4582-8756-59cdd498af45:3292:1871452237228288:0@lo:103: 00000100:00100000:2.0:1784756043.464350:0:5759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913469c4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a5739ad-a70a-4582-8756-59cdd498af45+12:3292:x1871452237228800:12345-0@lo:103: Request processed in 1158us (2461us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756043.464369:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784756043.464372:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89134687aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a5739ad-a70a-4582-8756-59cdd498af45:3292:1871452237228800:0@lo:103: 00000100:00100000:1.0:1784756043.467094:0:8279:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a81500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8279:1871452237226880:192.168.202.41@tcp:104: 00000100:00100000:1.0:1784756043.467112:0:8279:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a81880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8279:1871452237227008:192.168.202.41@tcp:104: 00010000:00010000:1.0:1784756043.467177:0:8279:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89135fc59c00/0xc0f560bd53f9039 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756043.467680:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1784756043.467747:0:5760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228816896 00000100:00100000:1.0:1784756043.467756:0:5760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228816896 00010000:00010000:1.0:1784756043.467790:0:5760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891382146600/0xc0f560bd53f9001 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xf9935e598575abd2 expref: 10 pid: 5769 timeout: 261 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756043.467822:0:5760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 19 00000100:00100000:1.0:1784756043.467832:0:5760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f417800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e891795-8b87-4754-b411-3420f9834f05+10:2351:x1871452228816896:12345-192.168.202.41@tcp:103: 00010000:00010000:1.0:1784756043.467846:0:5760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784756043.467852:0:5760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891382146600/0xc0f560bd53f9001 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xf9935e598575abd2 expref: 10 pid: 5769 timeout: 261 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756043.467863:0:5760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891382146600/0xc0f560bd53f9001 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0xf9935e598575abd2 expref: 10 pid: 5769 timeout: 261 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756043.467881:0:5760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891382146600/0xc0f560bd53f9001 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0xf9935e598575abd2 expref: 10 pid: 5769 timeout: 261 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756043.467897:0:5760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784756043.468325:0:5760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f417800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e891795-8b87-4754-b411-3420f9834f05+9:2351:x1871452228816896:12345-192.168.202.41@tcp:103: Request processed in 491us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756043.468334:0:5760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 19 00000100:00100000:0.0:1784756043.470459:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1784756043.470581:0:5759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228817024 00000100:00100000:1.0:1784756043.470591:0:5759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228817024 00010000:00010000:1.0:1784756043.470640:0:5759:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891342bae600/0xc0f560bd53f8ffa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xf9935e598575abcb expref: 9 pid: 6669 timeout: 261 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756043.470693:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 20 00000100:00100000:1.0:1784756043.470703:0:5759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f414700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e891795-8b87-4754-b411-3420f9834f05+9:2352:x1871452228817024:12345-192.168.202.41@tcp:103: 00010000:00010000:1.0:1784756043.470739:0:5759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784756043.470746:0:5759:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891342bae600/0xc0f560bd53f8ffa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xf9935e598575abcb expref: 9 pid: 6669 timeout: 261 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756043.470757:0:5759:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891342bae600/0xc0f560bd53f8ffa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0xf9935e598575abcb expref: 9 pid: 6669 timeout: 261 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756043.470775:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891342bae600/0xc0f560bd53f8ffa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0xf9935e598575abcb expref: 9 pid: 6669 timeout: 261 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756043.470792:0:5759:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89135fc59c00/0xc0f560bd53f9039 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756043.470800:0:5759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89135fc59c00/0xc0f560bd53f9039 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756043.470815:0:5759:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89135fc59c00/0xc0f560bd53f9039 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756043.470821:0:5759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89135fc59c00/0xc0f560bd53f9039 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756043.470828:0:5759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89135fc59c00/0xc0f560bd53f9039 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756043.470835:0:5759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89135fc59c00/0xc0f560bd53f9039 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756043.470840:0:5759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89135fc59c00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784756043.470845:0:5759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89135fc59c00/0xc0f560bd53f9039 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756043.470860:0:5759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89135fc59c00/0xc0f560bd53f9039 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756043.470888:0:5759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89135fc59c00/0xc0f560bd53f9039 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756043.470900:0:5759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784756043.470921:0:8279:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89135fc59c00/0xc0f560bd53f9039 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756043.470929:0:8279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89135fc59c00/0xc0f560bd53f9039 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756043.470934:0:8279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89135fc59c00/0xc0f560bd53f9039 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756043.470942:0:5759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f414700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e891795-8b87-4754-b411-3420f9834f05+8:2352:x1871452228817024:12345-192.168.202.41@tcp:103: Request processed in 240us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756043.470948:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 20 00010000:00010000:0.0:1784756044.158308:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756044.599203:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3291:1871452237229056:0@lo:400: 00000100:00100000:3.0:1784756044.599299:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756044.599366:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3291:1871452237229568:0@lo:400: 00000100:00100000:3.0:1784756044.599390:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756044.599443:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1784756044.599449:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3a5739ad-a70a-4582-8756-59cdd498af45:3291:1871452237228928:0@lo:400: 00000100:00100000:3.0:1784756044.599491:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756044.599637:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3291:1871452237229440:0@lo:400: 00000100:00100000:3.0:1784756044.599679:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756044.599732:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237229568 00000100:00100000:3.0:1784756044.599740:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237229568 00000100:00100000:3.0:1784756044.599800:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784756044.599809:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1871452237229568:12345-0@lo:400: 00000100:00100000:3.0:1784756044.599870:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1871452237229568:12345-0@lo:400: Request processed in 62us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756044.599878:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784756044.600331:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237228928 00000100:00100000:2.0:1784756044.600336:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237228928 00000100:00100000:2.0:1784756044.600369:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1784756044.600376:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347ad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+12:3291:x1871452237228928:12345-0@lo:400: 00000100:00100000:2.0:1784756044.600429:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347ad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+12:3291:x1871452237228928:12345-0@lo:400: Request processed in 39us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756044.600435:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1784756044.600464:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237229056 00000100:00100000:2.0:1784756044.600468:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237229056 00000100:00100000:2.0:1784756044.600494:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237229440 00000100:00100000:2.0:1784756044.600497:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237229440 00000100:00100000:1.0:1784756044.600627:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3292:1871452237229184:0@lo:400: 00000100:00100000:1.0:1784756044.600679:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756044.600705:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784756044.600711:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237229312:0@lo:400: 00000100:00100000:1.0:1784756044.600732:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784756044.600755:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784756044.600766:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237229184 00000100:00100000:1.0:1784756044.600770:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237229184 00000100:00100000:0.0:1784756044.600876:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237229312 00000100:00100000:0.0:1784756044.600881:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237229312 00000100:00100000:0.0:1784756044.600910:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784756044.600917:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375a81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237229312:12345-0@lo:400: 00000100:00100000:0.0:1784756044.600952:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375a81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237229312:12345-0@lo:400: Request processed in 36us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756044.600970:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784756044.601001:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136f415880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237229696:0@lo:13: 00000100:00100000:0.0:1784756044.601043:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756044.601326:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1784756044.601352:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891353e87b80 x1871452237229312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756044.601367:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237229312:0@lo:400: 00000100:00100000:0.0:1784756044.601400:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237229696 00000100:00100000:0.0:1784756044.601404:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237229696 00000100:00100000:0.0:1784756044.601451:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784756044.601459:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237229696:12345-0@lo:13: 00002000:00000024:0.0:1784756044.601486:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784756044.601984:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784756044.602181:0:5774:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1784756044.602189:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00080000:1.0:1784756044.602203:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784756044.602206:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784756044.602343:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237229696:12345-0@lo:13: Request processed in 885us (1298us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756044.602351:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1784756044.602391:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136f415880 x1871452237229696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756060 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756044.602406:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136f415880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237229696:0@lo:13: 00000100:00100000:0.0:1784756044.602463:0:5775:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1784756044.602472:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784756044.602480:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1871452237229184:12345-0@lo:400: 00000100:00100000:2.0:1784756044.602885:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375ee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1871452237229056:12345-0@lo:400: 00000100:00100000:2.0:1784756044.602927:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375ee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1871452237229056:12345-0@lo:400: Request processed in 1595us (3628us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756044.602934:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784756044.604141:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1871452237229184:12345-0@lo:400: Request processed in 1658us (3456us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756044.604151:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784756044.604201:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3292:1871452237229184:0@lo:400: 00000100:00100000:1.0:1784756044.605674:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3a5739ad-a70a-4582-8756-59cdd498af45:3291:1871452237228928:0@lo:400: 00000100:00100000:1.0:1784756044.605699:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3291:1871452237229056:0@lo:400: 00010000:00080000:1.0:1784756044.605717:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891353e84700 x1871452237229568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756044.605728:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3291:1871452237229568:0@lo:400: 00000100:00100000:3.0:1784756044.607926:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375ee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1871452237229440:12345-0@lo:400: 00000100:00100000:3.0:1784756044.608041:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375ee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1871452237229440:12345-0@lo:400: Request processed in 6049us (8360us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756044.608051:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784756044.611487:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3291:1871452237229440:0@lo:400: 10000000:01000000:2.0:1784756044.662886:0:5772:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784756044.662894:0:5772:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89136f870000 from 39 10000000:01000000:2.0:1784756044.662900:0:5772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784756044.662950:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff891340030200/0xc0f560bd53f9040 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756044.662961:0:5772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff891340030200/0xc0f560bd53f9040 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756044.662971:0:5772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff891340030200/0xc0f560bd53f9040 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756044.663010:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237229824:0@lo:101: 00000100:00100000:2.0:1784756044.663085:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756044.663130:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913517d0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784756044.663287:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237229824 00000100:00100000:3.0:1784756044.663295:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237229824 00000100:00100000:3.0:1784756044.663350:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1784756044.663358:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347ad3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+12:5772:x1871452237229824:12345-0@lo:101: 00010000:00010000:3.0:1784756044.663371:0:5767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784756044.663384:0:5767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89134151a400/0xc0f560bd53f9047 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0f560bd53f9040 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756044.663407:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89134151a400/0xc0f560bd53f9047 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0f560bd53f9040 expref: 13 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756044.663450:0:5767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89134151a400/0xc0f560bd53f9047 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f9040 expref: 13 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756044.663459:0:5767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89134151a400, rc 0) 00000100:00100000:3.0:1784756044.663512:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347ad3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+13:5772:x1871452237229824:12345-0@lo:101: Request processed in 154us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756044.663519:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1784756044.663666:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237229824:0@lo:101: 00010000:00010000:1.0:1784756044.663682:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff891340030200/0xc0f560bd53f9040 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f9047 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756044.663692:0:5772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff891340030200/0xc0f560bd53f9040 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0f560bd53f9047 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756044.663767:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a80000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237229952:0@lo:501: 00000100:00100000:1.0:1784756044.663795:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756044.663826:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913754e4600 going to sleep for 11 seconds 00000100:00100000:3.0:1784756044.664023:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237229952 00000100:00100000:3.0:1784756044.664028:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237229952 00000100:00100000:3.0:1784756044.664057:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1784756044.664070:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347ad1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+13:5772:x1871452237229952:12345-0@lo:501: 00000100:00100000:3.0:1784756044.664338:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347ad1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+13:5772:x1871452237229952:12345-0@lo:501: Request processed in 274us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756044.664344:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1784756044.664918:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a80000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237229952:0@lo:501: 00000100:00100000:1.0:1784756044.664959:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a80000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237230080:0@lo:503: 00000100:00100000:1.0:1784756044.665015:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756044.665047:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913754e4600 going to sleep for 11 seconds 00000100:00100000:2.0:1784756044.669391:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237230080 00000100:00100000:2.0:1784756044.669407:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237230080 00000100:00100000:2.0:1784756044.669497:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1784756044.669508:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347ad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+13:5772:x1871452237230080:12345-0@lo:503: 00000100:00100000:2.0:1784756044.669769:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347ad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+13:5772:x1871452237230080:12345-0@lo:503: Request processed in 263us (4752us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756044.669777:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1784756044.669845:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a80000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237230080:0@lo:503: 00000100:00100000:2.0:1784756044.670062:0:8298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e86a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:8298:1871452237230208:0@lo:502: 00000100:00100000:2.0:1784756044.670302:0:8298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756044.670327:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237230208 00000100:00100000:2.0:1784756044.670330:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237230208 00000100:00100000:2.0:1784756044.670352:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1784756044.670358:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347ad0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+13:8298:x1871452237230208:12345-0@lo:502: 00000100:00100000:2.0:1784756044.670587:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347ad0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+13:8298:x1871452237230208:12345-0@lo:502: Request processed in 229us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756044.670594:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1784756044.670638:0:8298:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913517d0900 going to sleep for 11 seconds 00000100:00100000:2.0:1784756044.670661:0:8298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e86a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:8298:1871452237230208:0@lo:502: 00000100:00100000:2.0:1784756044.670702:0:8298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e86a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:8298:1871452237230336:0@lo:502: 00000100:00100000:2.0:1784756044.670735:0:8298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756044.670766:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237230336 00000100:00100000:2.0:1784756044.670770:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237230336 00000100:00100000:2.0:1784756044.670791:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1784756044.670796:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347ad3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+13:8298:x1871452237230336:12345-0@lo:502: 00000100:00100000:2.0:1784756044.670914:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347ad3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+13:8298:x1871452237230336:12345-0@lo:502: Request processed in 117us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756044.670920:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1784756044.670950:0:8298:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913517d0900 going to sleep for 11 seconds 00000100:00100000:2.0:1784756044.670961:0:8298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e86a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:8298:1871452237230336:0@lo:502: 00000040:00080000:2.0:1784756044.670978:0:8298:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1784756044.671041:0:5772:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1784756044.671060:0:5772:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784756044.672357:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff891340030200/0xc0f560bd53f9040 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f9047 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756044.672371:0:5772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff891340030200/0xc0f560bd53f9040 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f9047 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784756044.672382:0:5772:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1784756044.672384:0:5772:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1784756044.672387:0:5772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1784756044.672717:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff891340030800/0xc0f560bd53f904e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756044.672727:0:5772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff891340030800/0xc0f560bd53f904e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756044.672737:0:5772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff891340030800/0xc0f560bd53f904e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756044.672771:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237230464:0@lo:101: 00000100:00100000:2.0:1784756044.672822:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756044.672904:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913517d0900 going to sleep for 11 seconds 00000100:00100000:0.0:1784756044.677577:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237230464 00000100:00100000:0.0:1784756044.677593:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237230464 00000100:00100000:0.0:1784756044.677668:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1784756044.677679:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347ad1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+13:5772:x1871452237230464:12345-0@lo:101: 00010000:00010000:0.0:1784756044.677698:0:6669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756044.677716:0:6669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891342baf600/0xc0f560bd53f9055 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0f560bd53f904e expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756044.677747:0:6669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891342baf600/0xc0f560bd53f9055 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0f560bd53f904e expref: 14 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756044.677758:0:6669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891342baf600/0xc0f560bd53f9055 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f904e expref: 14 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756044.677768:0:6669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891342baf600, rc 0) 00000100:00100000:0.0:1784756044.677844:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347ad1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+14:5772:x1871452237230464:12345-0@lo:101: Request processed in 168us (5021us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756044.677852:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1784756044.678137:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237230464:0@lo:101: 00010000:00010000:1.0:1784756044.678168:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff891340030800/0xc0f560bd53f904e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f9055 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756044.678179:0:5772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff891340030800/0xc0f560bd53f904e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0f560bd53f9055 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756044.678258:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237230592:0@lo:501: 00000100:00100000:1.0:1784756044.678294:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756044.678338:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913754e4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784756044.678389:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237230592 00000100:00100000:3.0:1784756044.678394:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237230592 00000100:00100000:3.0:1784756044.678484:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1784756044.678493:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347ad2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+14:5772:x1871452237230592:12345-0@lo:501: 00000100:00100000:3.0:1784756044.678783:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347ad2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+14:5772:x1871452237230592:12345-0@lo:501: Request processed in 291us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756044.678790:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1784756044.683542:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237230592:0@lo:501: 00000100:00100000:1.0:1784756044.683614:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237230720:0@lo:503: 00000100:00100000:1.0:1784756044.683798:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756044.683836:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913754e4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784756044.683916:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237230720 00000100:00100000:0.0:1784756044.683924:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237230720 00000100:00100000:0.0:1784756044.683978:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1784756044.683988:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+14:5772:x1871452237230720:12345-0@lo:503: 00000100:00100000:0.0:1784756044.684210:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+14:5772:x1871452237230720:12345-0@lo:503: Request processed in 223us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756044.684217:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1784756044.684447:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237230720:0@lo:503: 00000100:00100000:1.0:1784756044.684966:0:8299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a82d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:8299:1871452237230848:0@lo:502: 00000100:00100000:1.0:1784756044.685075:0:8299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756044.685110:0:8299:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913754e4480 going to sleep for 11 seconds 00000100:00100000:2.0:1784756044.685178:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237230848 00000100:00100000:2.0:1784756044.685184:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237230848 00000100:00100000:2.0:1784756044.685223:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1784756044.685231:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+14:8299:x1871452237230848:12345-0@lo:502: 00000100:00100000:2.0:1784756044.685445:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+14:8299:x1871452237230848:12345-0@lo:502: Request processed in 214us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756044.685452:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1784756044.685689:0:8299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a82d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:8299:1871452237230848:0@lo:502: 00000020:01000000:1.0:1784756044.685717:0:8299:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784756044.685726:0:8299:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784756044.685729:0:8299:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1784756044.685735:0:8299:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1784756044.685759:0:8299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a82d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:8299:1871452237230976:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784756044.685796:0:8299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756044.685828:0:8299:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913754e4480 going to sleep for 11 seconds 00000100:00100000:0.0:1784756044.685885:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237230976 00000100:00100000:0.0:1784756044.685890:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237230976 00000100:00100000:0.0:1784756044.685925:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1784756044.685932:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+14:8299:x1871452237230976:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784756044.686092:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+14:8299:x1871452237230976:12345-0@lo:502:llog_process_th.0 Request processed in 160us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756044.686100:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1784756044.686330:0:8299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a82d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:8299:1871452237230976:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784756044.686351:0:8299:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784756044.686356:0:8299:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784756044.686358:0:8299:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1784756044.686362:0:8299:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1784756044.686634:0:5772:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1784756044.686666:0:5772:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1784756044.686677:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff891340030800/0xc0f560bd53f904e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f9055 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756044.686689:0:5772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff891340030800/0xc0f560bd53f904e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f9055 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784756044.686699:0:5772:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784756044.686702:0:5772:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff891342e9d800 from 39 10000000:01000000:2.0:1784756044.686704:0:5772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784756044.686735:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff891340031800/0xc0f560bd53f905c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756044.686743:0:5772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff891340031800/0xc0f560bd53f905c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756044.686752:0:5772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff891340031800/0xc0f560bd53f905c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756044.686774:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e84380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237231104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784756044.686810:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756044.686849:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913517d0600 going to sleep for 11 seconds 00000100:00100000:0.0:1784756044.686905:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237231104 00000100:00100000:0.0:1784756044.686910:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237231104 00000100:00100000:0.0:1784756044.686948:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1784756044.686955:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+14:5772:x1871452237231104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784756044.686965:0:5768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756044.686978:0:5768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891342baf000/0xc0f560bd53f9063 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0f560bd53f905c expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756044.686999:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891342baf000/0xc0f560bd53f9063 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0f560bd53f905c expref: 15 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756044.687106:0:5768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891342baf000/0xc0f560bd53f9063 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f905c expref: 15 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756044.687117:0:5768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891342baf000, rc 0) 00000100:00100000:0.0:1784756044.687165:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+15:5772:x1871452237231104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 210us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756044.687172:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1784756044.687307:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e84380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237231104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784756044.687321:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff891340031800/0xc0f560bd53f905c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f9063 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756044.687331:0:5772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff891340031800/0xc0f560bd53f905c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0f560bd53f9063 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756044.687375:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e84380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237231232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784756044.687400:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756044.687593:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913517d0600 going to sleep for 11 seconds 00000100:00100000:0.0:1784756044.687643:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237231232 00000100:00100000:0.0:1784756044.687648:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237231232 00000100:00100000:0.0:1784756044.687729:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1784756044.687736:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+15:5772:x1871452237231232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784756044.687986:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+15:5772:x1871452237231232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 250us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756044.688004:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1784756044.688144:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e84380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237231232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784756044.688184:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e84380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237231360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784756044.688219:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756044.693284:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913517d0600 going to sleep for 11 seconds 00000100:00100000:3.0:1784756044.693466:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237231360 00000100:00100000:3.0:1784756044.693476:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237231360 00000100:00100000:3.0:1784756044.693532:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1784756044.693541:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+15:5772:x1871452237231360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784756044.693787:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+15:5772:x1871452237231360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 246us (5565us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756044.693802:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1784756044.694359:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e84380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237231360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784756044.695577:0:8300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e84380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:8300:1871452237231488:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784756044.695650:0:8300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756044.695714:0:8300:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913517d0180 going to sleep for 11 seconds 00000100:00100000:3.0:1784756044.695763:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237231488 00000100:00100000:3.0:1784756044.695770:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237231488 00000100:00100000:3.0:1784756044.695801:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1784756044.695809:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+15:8300:x1871452237231488:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784756044.696578:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+15:8300:x1871452237231488:12345-0@lo:502:llog_process_th.0 Request processed in 766us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756044.696587:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1784756044.701133:0:8300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e84380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:8300:1871452237231488:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784756044.701317:0:8300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e84380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:8300:1871452237231616:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784756044.701405:0:8300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756044.701584:0:8300:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913517d0180 going to sleep for 11 seconds 00000100:00100000:1.0:1784756044.701674:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237231616 00000100:00100000:1.0:1784756044.701682:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237231616 00000100:00100000:0.0:1784756044.701785:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1784756044.701796:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+15:8300:x1871452237231616:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784756044.702406:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+15:8300:x1871452237231616:12345-0@lo:502:llog_process_th.0 Request processed in 610us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756044.702438:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1784756044.702677:0:8300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e84380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:8300:1871452237231616:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1784756044.702706:0:8300:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1784756044.702960:0:5772:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1784756044.702979:0:5772:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784756044.702989:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff891340031800/0xc0f560bd53f905c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f9063 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756044.703001:0:5772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff891340031800/0xc0f560bd53f905c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f9063 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784756044.703078:0:5772:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1784756044.703082:0:5772:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1784756044.703085:0:5772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1784756044.703118:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff89134151aa00/0xc0f560bd53f906a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756044.703126:0:5772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff89134151aa00/0xc0f560bd53f906a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756044.703135:0:5772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff89134151aa00/0xc0f560bd53f906a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756044.703224:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375ee5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237231744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784756044.703279:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756044.703356:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff891342e77a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784756044.703396:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237231744 00000100:00100000:0.0:1784756044.703402:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237231744 00000100:00100000:0.0:1784756044.703619:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1784756044.703627:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+15:5772:x1871452237231744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784756044.703639:0:6669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756044.703661:0:6669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891342bae800/0xc0f560bd53f9071 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0f560bd53f906a expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756044.703685:0:6669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891342bae800/0xc0f560bd53f9071 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0f560bd53f906a expref: 16 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756044.703695:0:6669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891342bae800/0xc0f560bd53f9071 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f906a expref: 16 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756044.703704:0:6669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891342bae800, rc 0) 00000100:00100000:0.0:1784756044.703746:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+16:5772:x1871452237231744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756044.703752:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1784756044.703810:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375ee5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237231744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784756044.703824:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff89134151aa00/0xc0f560bd53f906a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f9071 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756044.703832:0:5772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff89134151aa00/0xc0f560bd53f906a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0f560bd53f9071 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756044.703878:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e84380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237231872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784756044.703914:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756044.704126:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913517d0180 going to sleep for 11 seconds 00000100:00100000:3.0:1784756044.704258:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237231872 00000100:00100000:3.0:1784756044.704264:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237231872 00000100:00100000:3.0:1784756044.704300:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1784756044.704306:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+16:5772:x1871452237231872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784756044.704579:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+16:5772:x1871452237231872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 272us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756044.704587:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1784756044.704724:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e84380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237231872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784756044.704755:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e84380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237232000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784756044.704794:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756044.704818:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913517d0180 going to sleep for 11 seconds 00000100:00100000:3.0:1784756044.704870:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237232000 00000100:00100000:3.0:1784756044.704874:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237232000 00000100:00100000:3.0:1784756044.704986:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1784756044.704995:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+16:5772:x1871452237232000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784756044.705272:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+16:5772:x1871452237232000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 278us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756044.705279:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1784756044.705738:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e84380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237232000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784756044.705937:0:8301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e84380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:8301:1871452237232128:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784756044.705982:0:8301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756044.706018:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237232128 00000100:00100000:2.0:1784756044.706023:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237232128 00000100:00100000:2.0:1784756044.706046:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1784756044.706053:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+16:8301:x1871452237232128:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784756044.706339:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+16:8301:x1871452237232128:12345-0@lo:502:llog_process_th.0 Request processed in 285us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756044.706346:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1784756044.706388:0:8301:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913517d0240 going to sleep for 11 seconds 00000100:00100000:2.0:1784756044.706401:0:8301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e84380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:8301:1871452237232128:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784756044.706440:0:8301:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784756044.706448:0:8301:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784756044.706451:0:8301:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1784756044.706456:0:8301:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1784756044.706475:0:8301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e84380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:8301:1871452237232256:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784756044.706510:0:8301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756044.706529:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237232256 00000100:00100000:2.0:1784756044.706532:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237232256 00000100:00100000:2.0:1784756044.706547:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1784756044.706552:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+16:8301:x1871452237232256:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784756044.706664:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+16:8301:x1871452237232256:12345-0@lo:502:llog_process_th.0 Request processed in 100us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756044.706671:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1784756044.706698:0:8301:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913517d0240 going to sleep for 11 seconds 00000100:00100000:2.0:1784756044.706709:0:8301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e84380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:8301:1871452237232256:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784756044.706724:0:8301:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784756044.706728:0:8301:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784756044.706730:0:8301:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1784756044.706733:0:8301:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1784756044.706774:0:5772:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1784756044.706789:0:5772:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1784756044.706797:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff89134151aa00/0xc0f560bd53f906a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f9071 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756044.706813:0:5772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff89134151aa00/0xc0f560bd53f906a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f9071 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784756044.706823:0:5772:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784756044.706826:0:5772:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8913516af000 from 39 10000000:01000000:2.0:1784756044.706829:0:5772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784756044.706850:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff891340031400/0xc0f560bd53f9078 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756044.706857:0:5772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff891340031400/0xc0f560bd53f9078 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756044.706866:0:5772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff891340031400/0xc0f560bd53f9078 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756044.706877:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e84380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237232384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784756044.706901:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756044.706913:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913517d0240 going to sleep for 11 seconds 00000100:00100000:2.0:1784756044.706923:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237232384 00000100:00100000:2.0:1784756044.706925:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237232384 00000100:00100000:2.0:1784756044.706941:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1784756044.706947:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+16:5772:x1871452237232384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784756044.706955:0:5768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756044.706966:0:5768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891340030a00/0xc0f560bd53f907f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0f560bd53f9078 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756044.706986:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891340030a00/0xc0f560bd53f907f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0f560bd53f9078 expref: 17 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756044.707073:0:5768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891340030a00/0xc0f560bd53f907f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f9078 expref: 17 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756044.707083:0:5768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891340030a00, rc 0) 00000100:00100000:2.0:1784756044.707114:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+17:5772:x1871452237232384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756044.707121:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1784756044.707378:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e84380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237232384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784756044.707393:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff891340031400/0xc0f560bd53f9078 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f907f expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756044.707402:0:5772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff891340031400/0xc0f560bd53f9078 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0f560bd53f907f expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756044.707463:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e84380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237232512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784756044.707487:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756044.707500:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913517d0240 going to sleep for 11 seconds 00000100:00100000:2.0:1784756044.707511:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237232512 00000100:00100000:2.0:1784756044.707515:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237232512 00000100:00100000:2.0:1784756044.707530:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1784756044.707535:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+17:5772:x1871452237232512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784756044.707761:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+17:5772:x1871452237232512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 225us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756044.707767:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1784756044.707794:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e84380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237232512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784756044.707826:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e84380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237232640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784756044.707856:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756044.707868:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913517d0240 going to sleep for 11 seconds 00000100:00100000:2.0:1784756044.707879:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237232640 00000100:00100000:2.0:1784756044.707883:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237232640 00000100:00100000:2.0:1784756044.707898:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1784756044.707903:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+17:5772:x1871452237232640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784756044.708345:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+17:5772:x1871452237232640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 440us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756044.708353:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1784756044.708392:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e84380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237232640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784756044.709095:0:8302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375ee5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:8302:1871452237232768:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784756044.709143:0:8302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756044.709276:0:8302:0:(client.c:2702:ptlrpc_set_wait()) set ffff89137540d900 going to sleep for 11 seconds 00000100:00100000:2.0:1784756044.709312:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237232768 00000100:00100000:2.0:1784756044.709318:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237232768 00000100:00100000:2.0:1784756044.709375:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1784756044.709383:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+17:8302:x1871452237232768:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784756044.709671:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+17:8302:x1871452237232768:12345-0@lo:502:llog_process_th.0 Request processed in 288us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756044.709680:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1784756044.709816:0:8302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375ee5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:8302:1871452237232768:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784756044.709861:0:8302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375ee5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:8302:1871452237232896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784756044.709959:0:8302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756044.710027:0:8302:0:(client.c:2702:ptlrpc_set_wait()) set ffff89137540d900 going to sleep for 11 seconds 00000100:00100000:2.0:1784756044.710111:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237232896 00000100:00100000:2.0:1784756044.710116:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237232896 00000100:00100000:2.0:1784756044.710375:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1784756044.710384:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+17:8302:x1871452237232896:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784756044.710580:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+17:8302:x1871452237232896:12345-0@lo:502:llog_process_th.0 Request processed in 197us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756044.710587:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1784756044.710691:0:8302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375ee5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:8302:1871452237232896:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1784756044.710715:0:8302:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1784756044.710854:0:5772:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1784756044.710871:0:5772:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784756044.710879:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff891340031400/0xc0f560bd53f9078 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f907f expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756044.710889:0:5772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff891340031400/0xc0f560bd53f9078 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f907f expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784756044.711087:0:5772:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1784756044.711089:0:5772:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1784756044.711092:0:5772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1784756044.711118:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff891340030c00/0xc0f560bd53f9086 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756044.711126:0:5772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff891340030c00/0xc0f560bd53f9086 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756044.711134:0:5772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff891340030c00/0xc0f560bd53f9086 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756044.711216:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e84380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237233024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784756044.711251:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756044.711284:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913819396c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784756044.711328:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237233024 00000100:00100000:1.0:1784756044.711333:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237233024 00000100:00100000:1.0:1784756044.711374:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1784756044.711382:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346888050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+17:5772:x1871452237233024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784756044.711398:0:5767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784756044.711410:0:5767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89135fc58400/0xc0f560bd53f908d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0f560bd53f9086 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756044.711461:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89135fc58400/0xc0f560bd53f908d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0f560bd53f9086 expref: 18 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756044.711471:0:5767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89135fc58400/0xc0f560bd53f908d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f9086 expref: 18 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756044.711479:0:5767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89135fc58400, rc 0) 00000100:00100000:1.0:1784756044.711511:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346888050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+18:5772:x1871452237233024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756044.711517:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1784756044.711638:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e84380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237233024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784756044.711661:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff891340030c00/0xc0f560bd53f9086 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f908d expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756044.711670:0:5772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff891340030c00/0xc0f560bd53f9086 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0f560bd53f908d expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756044.711726:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e84380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237233152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784756044.711749:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756044.711777:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913819396c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784756044.711790:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237233152 00000100:00100000:2.0:1784756044.711793:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237233152 00000100:00100000:2.0:1784756044.711858:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1784756044.711866:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+18:5772:x1871452237233152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784756044.712377:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+18:5772:x1871452237233152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 511us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756044.712385:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1784756044.712599:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e84380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237233152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784756044.712634:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375ee7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237233280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784756044.712688:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756044.712712:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff89137540d240 going to sleep for 11 seconds 00000100:00100000:3.0:1784756044.712726:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237233280 00000100:00100000:3.0:1784756044.712731:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237233280 00000100:00100000:3.0:1784756044.712752:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1784756044.712758:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+18:5772:x1871452237233280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784756044.712900:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+18:5772:x1871452237233280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756044.712906:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1784756044.712936:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375ee7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237233280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784756044.717516:0:8303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e87480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:8303:1871452237233408:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784756044.717605:0:8303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756044.717632:0:8303:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913517d0600 going to sleep for 11 seconds 00000100:00100000:2.0:1784756044.717665:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237233408 00000100:00100000:2.0:1784756044.717672:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237233408 00000100:00100000:2.0:1784756044.717712:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1784756044.717720:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+18:8303:x1871452237233408:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784756044.717946:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+18:8303:x1871452237233408:12345-0@lo:502:llog_process_th.0 Request processed in 226us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756044.717954:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1784756044.718020:0:8303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e87480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:8303:1871452237233408:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784756044.718046:0:8303:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784756044.718054:0:8303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784756044.718057:0:8303:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1784756044.718067:0:8303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1784756044.718084:0:8303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e87480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:8303:1871452237233536:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784756044.718113:0:8303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756044.718130:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237233536 00000100:00100000:2.0:1784756044.718133:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237233536 00000100:00100000:2.0:1784756044.718152:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1784756044.718158:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+18:8303:x1871452237233536:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784756044.718273:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+18:8303:x1871452237233536:12345-0@lo:502:llog_process_th.0 Request processed in 114us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756044.718280:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1784756044.718308:0:8303:0:(client.c:2702:ptlrpc_set_wait()) set ffff89137cf61180 going to sleep for 11 seconds 00000100:00100000:2.0:1784756044.718321:0:8303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e87480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:8303:1871452237233536:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784756044.718338:0:8303:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784756044.718342:0:8303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784756044.718344:0:8303:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1784756044.718347:0:8303:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1784756044.718396:0:5772:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1784756044.718411:0:5772:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1784756044.718438:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff891340030c00/0xc0f560bd53f9086 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f908d expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756044.718450:0:5772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff891340030c00/0xc0f560bd53f9086 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f908d expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784756044.718460:0:5772:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1784756044.718463:0:5772:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff891347b0b380 from 1 10000000:01000000:2.0:1784756044.718465:0:5772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1784756044.718488:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff891340031000/0xc0f560bd53f9094 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756044.718505:0:5772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff891340031000/0xc0f560bd53f9094 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756044.718515:0:5772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff891340031000/0xc0f560bd53f9094 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756044.718529:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e87480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237233664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784756044.718556:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756044.718570:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff89137cf61180 going to sleep for 11 seconds 00000100:00100000:2.0:1784756044.718581:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237233664 00000100:00100000:2.0:1784756044.718585:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237233664 00000100:00100000:2.0:1784756044.718606:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1784756044.718613:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+18:5772:x1871452237233664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784756044.718621:0:5768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756044.718633:0:5768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891340031600/0xc0f560bd53f909b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0f560bd53f9094 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756044.718666:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891340031600/0xc0f560bd53f909b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0f560bd53f9094 expref: 19 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756044.718677:0:5768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891340031600/0xc0f560bd53f909b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f9094 expref: 19 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756044.718685:0:5768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891340031600, rc 0) 00000100:00100000:2.0:1784756044.718713:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+19:5772:x1871452237233664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756044.718719:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1784756044.718753:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e87480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237233664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784756044.718765:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff891340031000/0xc0f560bd53f9094 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f909b expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756044.718774:0:5772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff891340031000/0xc0f560bd53f9094 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0f560bd53f909b expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756044.718811:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e87480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237233792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784756044.718835:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756044.718848:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff89137cf61180 going to sleep for 11 seconds 00000100:00100000:2.0:1784756044.718858:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237233792 00000100:00100000:2.0:1784756044.718861:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237233792 00000100:00100000:2.0:1784756044.718877:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1784756044.718883:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+19:5772:x1871452237233792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784756044.719076:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+19:5772:x1871452237233792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 192us (239us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784756044.719083:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1784756044.719114:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e87480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237233792:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1784756044.719132:0:5772:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1784756044.719137:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff891340031000/0xc0f560bd53f9094 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f909b expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756044.719145:0:5772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff891340031000/0xc0f560bd53f9094 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f909b expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756045.171579:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756045.337484:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1784756045.337709:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228817152 00000100:00100000:2.0:1784756045.337736:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228817152 00000100:00100000:2.0:1784756045.337809:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 162 00000100:00100000:2.0:1784756045.337819:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346889050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e891795-8b87-4754-b411-3420f9834f05+8:5565:x1871452228817152:12345-192.168.202.41@tcp:101: 00010000:00010000:2.0:1784756045.337836:0:5768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756045.337865:0:5768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891340031a00/0xc0f560bd53f90a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9935e598575ac34 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756045.337896:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891340031a00/0xc0f560bd53f90a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac34 expref: 9 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756045.337907:0:5768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891340031a00/0xc0f560bd53f90a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac34 expref: 9 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756045.337916:0:5768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891340031a00, rc 0) 00000100:00100000:2.0:1784756045.337987:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346889050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e891795-8b87-4754-b411-3420f9834f05+9:5565:x1871452228817152:12345-192.168.202.41@tcp:101: Request processed in 169us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756045.337994:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 162 00000100:00100000:0.0:1784756045.344760:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1784756045.344820:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1784756045.344888:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1784756045.345091:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228817280 00000100:00100000:1.0:1784756045.345102:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228817280 00000100:00100000:1.0:1784756045.345184:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 27 00000100:00100000:1.0:1784756045.345195:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f415880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2351:x1871452228817280:12345-192.168.202.41@tcp:400: 00000100:00100000:1.0:1784756045.345303:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f415880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2351:x1871452228817280:12345-192.168.202.41@tcp:400: Request processed in 110us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756045.345311:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 27 00000100:00080000:0.0:1784756045.346037:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784756045.355323:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228817536 00000100:00100000:2.0:1784756045.355341:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228817536 00000100:00100000:2.0:1784756045.355453:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228817408 00000100:00100000:2.0:1784756045.355457:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228817408 00000100:00100000:2.0:1784756045.355482:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 12 00000100:00100000:2.0:1784756045.355491:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f414380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+5:2351:x1871452228817536:12345-192.168.202.41@tcp:400: 00000100:00100000:2.0:1784756045.355572:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f414380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+5:2351:x1871452228817536:12345-192.168.202.41@tcp:400: Request processed in 82us (10750us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756045.355579:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 12 00000100:00100000:2.0:1784756045.355596:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 13 00000100:00100000:2.0:1784756045.355602:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346760000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+5:2351:x1871452228817408:12345-192.168.202.41@tcp:400: 00000100:00100000:2.0:1784756045.355645:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346760000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+5:2351:x1871452228817408:12345-192.168.202.41@tcp:400: Request processed in 43us (10757us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756045.355689:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 13 00000100:00080000:0.0:1784756045.355830:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784756045.355835:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784756045.360372:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1784756045.369944:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228817664 00000100:00100000:3.0:1784756045.369961:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228817664 00000100:00100000:3.0:1784756045.370043:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 163 00000100:00100000:3.0:1784756045.370054:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e891795-8b87-4754-b411-3420f9834f05+9:5565:x1871452228817664:12345-192.168.202.41@tcp:501: 00000100:00100000:3.0:1784756045.370358:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e891795-8b87-4754-b411-3420f9834f05+9:5565:x1871452228817664:12345-192.168.202.41@tcp:501: Request processed in 305us (9995us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756045.370366:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 163 00000100:00100000:0.0:1784756045.376977:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1784756045.383963:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228817792 00000100:00100000:2.0:1784756045.383982:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228817792 00000100:00100000:2.0:1784756045.384327:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 164 00000100:00100000:2.0:1784756045.384339:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e891795-8b87-4754-b411-3420f9834f05+9:5565:x1871452228817792:12345-192.168.202.41@tcp:503: 00000100:00100000:2.0:1784756045.384608:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e891795-8b87-4754-b411-3420f9834f05+9:5565:x1871452228817792:12345-192.168.202.41@tcp:503: Request processed in 271us (7639us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756045.384617:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 164 00000100:00100000:0.0:1784756045.393283:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1784756045.398621:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228817920 00000100:00100000:2.0:1784756045.398638:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228817920 00000100:00100000:2.0:1784756045.398731:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 165 00000100:00100000:2.0:1784756045.398741:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e891795-8b87-4754-b411-3420f9834f05+9:6038:x1871452228817920:12345-192.168.202.41@tcp:502: 00000100:00100000:2.0:1784756045.399061:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e891795-8b87-4754-b411-3420f9834f05+9:6038:x1871452228817920:12345-192.168.202.41@tcp:502: Request processed in 320us (5788us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756045.399070:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 165 00000100:00100000:0.0:1784756045.414155:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1784756045.414341:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228818048 00000100:00100000:2.0:1784756045.414352:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228818048 00000100:00100000:2.0:1784756045.414399:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 166 00000100:00100000:2.0:1784756045.414409:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e891795-8b87-4754-b411-3420f9834f05+9:6038:x1871452228818048:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784756045.414723:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e891795-8b87-4754-b411-3420f9834f05+9:6038:x1871452228818048:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 315us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756045.414733:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 166 00000100:00100000:0.0:1784756045.427319:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1784756045.427463:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228818176 00000100:00100000:1.0:1784756045.427472:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228818176 00000100:00100000:1.0:1784756045.427522:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 167 00000100:00100000:1.0:1784756045.427533:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+9:5565:x1871452228818176:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784756045.427550:0:5767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784756045.427567:0:5767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89135fc59200/0xc0f560bd53f90a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9935e598575ac3b expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756045.427609:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89135fc59200/0xc0f560bd53f90a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac3b expref: 10 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756045.427620:0:5767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89135fc59200/0xc0f560bd53f90a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac3b expref: 10 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756045.427629:0:5767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89135fc59200, rc 0) 00000100:00100000:1.0:1784756045.427708:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+10:5565:x1871452228818176:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 Request processed in 177us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756045.427714:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 167 00000100:00100000:1.0:1784756045.432274:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1784756045.432455:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228818304 00000100:00100000:2.0:1784756045.432480:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228818304 00000100:00100000:2.0:1784756045.432536:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 168 00000100:00100000:2.0:1784756045.432546:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e891795-8b87-4754-b411-3420f9834f05+10:5565:x1871452228818304:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784756045.432861:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e891795-8b87-4754-b411-3420f9834f05+10:5565:x1871452228818304:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 Request processed in 315us (596us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784756045.432871:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 168 00010000:00010000:3.0:1784756046.197232:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784756046.623743:0:8341:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff45eff770 20000000:00000080:0.0:1784756046.623762:0:8341:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff89136bd85c00 uarg=0000000000000000 20000000:01000000:0.0:1784756046.623798:0:8341:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1784756046.623803:0:8341:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1784756046.623807:0:8341:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1784756046.635359:0:8342:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1784756046.635611:0:8341:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1784756046.648986:0:8341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1784756046.649047:0:8341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1784756046.649105:0:8341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1784756046.649123:0:8341:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1784756046.649142:0:8341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89135fc59400/0xc0f560bd53f90b0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756046.649160:0:8341:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8913429e5400/0xc0f560bd53f8e25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8e1e expref: 18 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756046.649167:0:8341:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89134151b200/0xc0f560bd53f8e87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8e80 expref: 18 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756046.649173:0:8341:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891342baee00/0xc0f560bd53f8f52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f8f4b expref: 18 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756046.649182:0:8341:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891382146e00/0xc0f560bd53f900f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac03 expref: 9 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756046.649200:0:8341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89135fc59400/0xc0f560bd53f90b0 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756046.649245:0:8341:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891382146e00/0xc0f560bd53f900f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac03 expref: 9 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756046.649262:0:8341:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff891382146e00/0xc0f560bd53f900f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac03 expref: 9 pid: 5769 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756046.649276:0:8341:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a82d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8341:1871452237233920:192.168.202.41@tcp:104: 00010000:00010000:1.0:1784756046.649395:0:8341:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891342baee00/0xc0f560bd53f8f52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0f560bd53f8f4b expref: 18 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756046.649404:0:8341:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff891342baee00/0xc0f560bd53f8f52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0f560bd53f8f4b expref: 18 pid: 5769 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756046.649452:0:8341:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a82300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8341:1871452237234048:0@lo:104: 00000100:00100000:1.0:1784756046.649494:0:8341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784756046.649532:0:8341:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89134151b200/0xc0f560bd53f8e87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0f560bd53f8e80 expref: 18 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756046.649540:0:8341:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89134151b200/0xc0f560bd53f8e87 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0f560bd53f8e80 expref: 18 pid: 5769 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756046.649548:0:8341:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a82a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8341:1871452237234176:0@lo:104: 00000100:00100000:1.0:1784756046.649572:0:8341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784756046.649592:0:8341:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8913429e5400/0xc0f560bd53f8e25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0f560bd53f8e1e expref: 18 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756046.649612:0:8341:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8913429e5400/0xc0f560bd53f8e25 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0f560bd53f8e1e expref: 18 pid: 5769 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756046.649620:0:8341:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a83800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8341:1871452237234304:0@lo:104: 00000100:00100000:1.0:1784756046.649651:0:8341:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913754e49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784756046.650318:0:5758:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1784756046.650341:0:5758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756046.650354:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237234048 00000100:00100000:3.0:1784756046.650362:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237234048 00000100:00100000:3.0:1784756046.650407:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237234176 00000100:00100000:3.0:1784756046.650410:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237234176 00000100:00100000:3.0:1784756046.650438:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237234304 00000100:00100000:3.0:1784756046.650441:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237234304 00000100:00100000:3.0:1784756046.650480:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784756046.650488:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375a81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3a5739ad-a70a-4582-8756-59cdd498af45+5:8341:x1871452237234048:12345-0@lo:104: 00010000:00010000:3.0:1784756046.650502:0:5758:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff891382147200/0xc0f560bd53f8f4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f8f52 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756046.650559:0:5758:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784756046.650565:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375a81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3a5739ad-a70a-4582-8756-59cdd498af45+5:8341:x1871452237234048:12345-0@lo:104: Request processed in 78us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756046.650572:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784756046.650733:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784756046.650741:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f58d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3a5739ad-a70a-4582-8756-59cdd498af45+4:8341:x1871452237234176:12345-0@lo:104: 00010000:00010000:3.0:1784756046.650749:0:5758:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff891342baf400/0xc0f560bd53f8e80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f8e87 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756046.650792:0:5758:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784756046.650797:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f58d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3a5739ad-a70a-4582-8756-59cdd498af45+4:8341:x1871452237234176:12345-0@lo:104: Request processed in 58us (1224us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756046.650802:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784756046.650832:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784756046.650837:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375ee7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3a5739ad-a70a-4582-8756-59cdd498af45+3:8341:x1871452237234304:12345-0@lo:104: 00010000:00010000:3.0:1784756046.650844:0:5758:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff891342bae200/0xc0f560bd53f8e1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f8e25 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756046.650873:0:5758:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1784756046.650877:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375ee7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3a5739ad-a70a-4582-8756-59cdd498af45+3:8341:x1871452237234304:12345-0@lo:104: Request processed in 41us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756046.650883:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1784756046.650903:0:7465:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784756046.650914:0:7465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff891382147200/0xc0f560bd53f8f4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f8f52 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756046.650921:0:7465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891382147200 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:3.0:1784756046.650924:0:7465:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff891382147200/0xc0f560bd53f8f4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0f560bd53f8f52 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756046.650932:0:7465:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff891382147200/0xc0f560bd53f8f4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0f560bd53f8f52 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784756046.650939:0:7465:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff891382147200/0xc0f560bd53f8f4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0f560bd53f8f52 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784756046.650945:0:7465:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784756046.650974:0:7465:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff891382147200/0xc0f560bd53f8f4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8f52 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756046.650980:0:7465:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784756046.651001:0:7465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff891382147200/0xc0f560bd53f8f4b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8f52 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756046.651008:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff891382147200/0xc0f560bd53f8f4b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8f52 expref: -99 pid: 7458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756046.651020:0:7465:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784756046.651023:0:7465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff891342baf400/0xc0f560bd53f8e80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f8e87 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756046.651028:0:7465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891342baf400 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:3.0:1784756046.651031:0:7465:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff891342baf400/0xc0f560bd53f8e80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0f560bd53f8e87 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756046.651047:0:7465:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff891342baf400/0xc0f560bd53f8e80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0f560bd53f8e87 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784756046.651053:0:7465:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff891342baf400/0xc0f560bd53f8e80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0f560bd53f8e87 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784756046.651057:0:7465:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784756046.651071:0:7465:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff891342baf400/0xc0f560bd53f8e80 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8e87 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756046.651077:0:7465:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784756046.651093:0:7465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff891342baf400/0xc0f560bd53f8e80 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8e87 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756046.651099:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff891342baf400/0xc0f560bd53f8e80 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8e87 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756046.651112:0:7465:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784756046.651114:0:7465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff891342bae200/0xc0f560bd53f8e1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f8e25 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756046.651120:0:7465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891342bae200 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:3.0:1784756046.651122:0:7465:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff891342bae200/0xc0f560bd53f8e1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0f560bd53f8e25 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756046.651128:0:7465:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff891342bae200/0xc0f560bd53f8e1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0f560bd53f8e25 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784756046.651134:0:7465:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff891342bae200/0xc0f560bd53f8e1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0f560bd53f8e25 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784756046.651146:0:7465:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784756046.651160:0:7465:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff891342bae200/0xc0f560bd53f8e1e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8e25 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756046.651165:0:7465:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784756046.651171:0:7465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff891342bae200/0xc0f560bd53f8e1e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8e25 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756046.651178:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff891342bae200/0xc0f560bd53f8e1e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f8e25 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756046.651191:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756046.651192:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756046.651194:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756046.651201:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756046.651213:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3a5739ad-a70a-4582-8756-59cdd498af45:3293:1871452237234432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784756046.651246:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756046.651296:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375ee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a5739ad-a70a-4582-8756-59cdd498af45:3290:1871452237234560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784756046.651320:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756046.651339:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784756046.651345:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375ee5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a5739ad-a70a-4582-8756-59cdd498af45:3290:1871452237234688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784756046.651366:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756046.651392:0:7464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237234432 00000100:00100000:3.0:1784756046.651397:0:7464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237234432 00010000:00010000:3.0:1784756046.651438:0:7464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891342baee00/0xc0f560bd53f8f52 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f8f4b expref: 19 pid: 5769 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756046.651458:0:7464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237234560 00000100:00100000:3.0:1784756046.651467:0:7464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237234560 00010000:00010000:3.0:1784756046.651481:0:7464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89134151b200/0xc0f560bd53f8e87 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f8e80 expref: 20 pid: 5769 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756046.651493:0:7464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237234688 00000100:00100000:3.0:1784756046.651496:0:7464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237234688 00010000:00010000:3.0:1784756046.651506:0:7464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8913429e5400/0xc0f560bd53f8e25 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f8e1e expref: 21 pid: 5769 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756046.651518:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784756046.651524:0:7464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375ee5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a5739ad-a70a-4582-8756-59cdd498af45+21:3293:x1871452237234432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784756046.651535:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784756046.651540:0:7464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891342baee00/0xc0f560bd53f8f52 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f8f4b expref: 21 pid: 5769 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756046.651549:0:7464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891342baee00/0xc0f560bd53f8f52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0f560bd53f8f4b expref: 21 pid: 5769 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756046.651568:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784756046.651758:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756046.654186:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784756046.654204:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891374d64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a5739ad-a70a-4582-8756-59cdd498af45+21:3290:x1871452237234560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784756046.654227:0:5761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784756046.654236:0:5761:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89134151b200/0xc0f560bd53f8e87 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f8e80 expref: 21 pid: 5769 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756046.654252:0:5761:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89134151b200/0xc0f560bd53f8e87 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0f560bd53f8e80 expref: 21 pid: 5769 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756046.654273:0:5761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784756046.656764:0:5760:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1784756046.656787:0:5760:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:1.0:1784756046.657078:0:8341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891342baee00/0xc0f560bd53f8f52 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0f560bd53f8f4b expref: 21 pid: 5769 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756046.657099:0:8341:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a82300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8341:1871452237234048:0@lo:104: 00010000:00010000:1.0:1784756046.657115:0:8341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89134151b200/0xc0f560bd53f8e87 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0f560bd53f8e80 expref: 20 pid: 5769 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756046.657125:0:8341:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a82a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8341:1871452237234176:0@lo:104: 00000100:00100000:1.0:1784756046.657136:0:8341:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a83800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8341:1871452237234304:0@lo:104: 00000100:00100000:3.0:1784756046.658796:0:7464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375ee5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a5739ad-a70a-4582-8756-59cdd498af45+19:3293:x1871452237234432:12345-0@lo:103:ldlm_bl.0 Request processed in 7265us (7542us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756046.658811:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784756046.658856:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784756046.658870:0:7464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891374d66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a5739ad-a70a-4582-8756-59cdd498af45+18:3290:x1871452237234688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784756046.658890:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784756046.658899:0:7464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8913429e5400/0xc0f560bd53f8e25 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f8e1e expref: 18 pid: 5769 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756046.658913:0:7464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8913429e5400/0xc0f560bd53f8e25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0f560bd53f8e1e expref: 18 pid: 5769 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756046.658952:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8913429e5400/0xc0f560bd53f8e25 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0f560bd53f8e1e expref: 18 pid: 5769 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756046.658968:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784756046.659020:0:7464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891374d66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a5739ad-a70a-4582-8756-59cdd498af45+17:3290:x1871452237234688:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (7652us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756046.659026:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784756046.659158:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375ee5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a5739ad-a70a-4582-8756-59cdd498af45:3290:1871452237234688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784756046.659266:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3a5739ad-a70a-4582-8756-59cdd498af45:3293:1871452237234432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784756046.661153:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891374d64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a5739ad-a70a-4582-8756-59cdd498af45+16:3290:x1871452237234560:12345-0@lo:103:ldlm_bl.0 Request processed in 6947us (9823us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756046.661170:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784756046.661241:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375ee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a5739ad-a70a-4582-8756-59cdd498af45:3290:1871452237234560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784756046.663031:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1784756046.663104:0:7464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228818432 00000100:00100000:3.0:1784756046.663115:0:7464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228818432 00010000:00010000:3.0:1784756046.663152:0:7464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891382146e00/0xc0f560bd53f900f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac03 expref: 10 pid: 5769 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756046.663196:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00100000:3.0:1784756046.663206:0:7464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891353e87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e891795-8b87-4754-b411-3420f9834f05+10:2352:x1871452228818432:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784756046.663220:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784756046.663225:0:7464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891382146e00/0xc0f560bd53f900f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac03 expref: 10 pid: 5769 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756046.663237:0:7464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891382146e00/0xc0f560bd53f900f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac03 expref: 10 pid: 5769 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756046.663261:0:7464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89135fc59400/0xc0f560bd53f90b0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756046.663269:0:7464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89135fc59400/0xc0f560bd53f90b0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756046.663306:0:7464:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89135fc59400/0xc0f560bd53f90b0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756046.663313:0:7464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89135fc59400/0xc0f560bd53f90b0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756046.663319:0:7464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89135fc59400/0xc0f560bd53f90b0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756046.663325:0:7464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89135fc59400/0xc0f560bd53f90b0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756046.663331:0:7464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89135fc59400 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:3.0:1784756046.663336:0:7464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89135fc59400/0xc0f560bd53f90b0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756046.663343:0:7464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89135fc59400/0xc0f560bd53f90b0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756046.663353:0:7464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89135fc59400/0xc0f560bd53f90b0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756046.663364:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784756046.663450:0:7464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891353e87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e891795-8b87-4754-b411-3420f9834f05+10:2352:x1871452228818432:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 245us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756046.663735:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 24 00010000:00010000:1.0:1784756046.663897:0:8341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891382146e00/0xc0f560bd53f900f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac03 expref: 9 pid: 5769 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756046.663911:0:8341:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a82d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8341:1871452237233920:192.168.202.41@tcp:104: 00010000:00010000:1.0:1784756046.663937:0:8341:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89135fc59400/0xc0f560bd53f90b0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756046.663947:0:8341:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89135fc59400/0xc0f560bd53f90b0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756046.663953:0:8341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89135fc59400/0xc0f560bd53f90b0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756046.663968:0:8341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89135fc59400/0xc0f560bd53f90b0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756047.155897:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891374d66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237234816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784756047.155976:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756047.156228:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237234816 00000100:00100000:3.0:1784756047.156236:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237234816 00000100:00100000:3.0:1784756047.156304:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784756047.156314:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891353e85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237234816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784756047.156357:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784756047.156404:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891353e85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237234816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756047.156411:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1784756047.156492:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784756047.156520:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891374d66d80 x1871452237234816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756063 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756047.156560:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891374d66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237234816:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784756047.220084:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784756048.179664:0:5772:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784756048.179672:0:5772:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89136f870000 from 4 10000000:01000000:2.0:1784756048.179677:0:5772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784756048.179799:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff891350391c00/0xc0f560bd53f90b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756048.179812:0:5772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff891350391c00/0xc0f560bd53f90b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756048.179824:0:5772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff891350391c00/0xc0f560bd53f90b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756048.179851:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e86d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237234944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784756048.179921:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756048.180214:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913584a4300 going to sleep for 11 seconds 00000100:00100000:3.0:1784756048.184103:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237234944 00000100:00100000:3.0:1784756048.184118:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237234944 00000100:00100000:3.0:1784756048.184190:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1784756048.184200:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+16:5772:x1871452237234944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784756048.184217:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784756048.184237:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89134151bc00/0xc0f560bd53f90be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0f560bd53f90b7 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756048.184265:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89134151bc00/0xc0f560bd53f90be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0f560bd53f90b7 expref: 17 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756048.184276:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89134151bc00/0xc0f560bd53f90be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f90b7 expref: 17 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756048.184285:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89134151bc00, rc 0) 00000100:00100000:3.0:1784756048.184658:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+17:5772:x1871452237234944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 459us (4736us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756048.184666:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1784756048.184846:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e86d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237234944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784756048.184865:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff891350391c00/0xc0f560bd53f90b7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f90be expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756048.184874:0:5772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff891350391c00/0xc0f560bd53f90b7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0f560bd53f90be expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756048.184950:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e86d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237235072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784756048.184995:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756048.185029:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913584a4300 going to sleep for 11 seconds 00000100:00100000:1.0:1784756048.185339:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237235072 00000100:00100000:1.0:1784756048.185344:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237235072 00000100:00100000:1.0:1784756048.185382:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1784756048.185390:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+17:5772:x1871452237235072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784756048.185672:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+17:5772:x1871452237235072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 283us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756048.185680:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1784756048.185850:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e86d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237235072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784756048.185886:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e86d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237235200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784756048.185923:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756048.185948:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913584a4300 going to sleep for 11 seconds 00000100:00100000:2.0:1784756048.185961:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237235200 00000100:00100000:2.0:1784756048.185965:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237235200 00000100:00100000:2.0:1784756048.185997:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1784756048.186001:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+17:5772:x1871452237235200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784756048.186126:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+17:5772:x1871452237235200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 123us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756048.186132:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1784756048.186178:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e86d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237235200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784756048.186354:0:8410:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e86d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:8410:1871452237235328:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784756048.186379:0:8410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756048.186392:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237235328 00000100:00100000:2.0:1784756048.186395:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237235328 00000100:00100000:2.0:1784756048.186406:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1784756048.186410:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+17:8410:x1871452237235328:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784756048.186514:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+17:8410:x1871452237235328:12345-0@lo:502:llog_process_th.0 Request processed in 102us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756048.186521:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1784756048.186546:0:8410:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913584a4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784756048.186557:0:8410:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e86d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:8410:1871452237235328:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784756048.186575:0:8410:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784756048.186584:0:8410:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784756048.186591:0:8410:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1784756048.186597:0:8410:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff89136f870000 00000020:00000080:2.0:1784756048.186599:0:8410:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784756048.186667:0:8410:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e86d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:8410:1871452237235456:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784756048.186690:0:8410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756048.186712:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237235456 00000100:00100000:2.0:1784756048.186715:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237235456 00000100:00100000:2.0:1784756048.186727:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1784756048.186730:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+17:8410:x1871452237235456:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784756048.186820:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+17:8410:x1871452237235456:12345-0@lo:502:llog_process_th.0 Request processed in 88us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756048.186825:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1784756048.186845:0:8410:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913584a4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784756048.186853:0:8410:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e86d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:8410:1871452237235456:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784756048.186866:0:8410:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784756048.186869:0:8410:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784756048.186870:0:8410:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1784756048.186872:0:8410:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1784756048.186916:0:5772:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1784756048.186930:0:5772:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784756048.186938:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff891350391c00/0xc0f560bd53f90b7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f90be expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756048.186949:0:5772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff891350391c00/0xc0f560bd53f90b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f90be expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784756048.186958:0:5772:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784756048.186961:0:5772:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff891342e9d800 from 4 10000000:01000000:2.0:1784756048.186964:0:5772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784756048.186992:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff891350391200/0xc0f560bd53f90c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756048.186998:0:5772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff891350391200/0xc0f560bd53f90c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756048.187004:0:5772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff891350391200/0xc0f560bd53f90c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756048.187012:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e86d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237235584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784756048.187030:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756048.187039:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff89135906b000 going to sleep for 11 seconds 00000100:00100000:2.0:1784756048.187047:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237235584 00000100:00100000:2.0:1784756048.187049:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237235584 00000100:00100000:2.0:1784756048.187062:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1784756048.187068:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+17:5772:x1871452237235584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784756048.187075:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756048.187085:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891350390600/0xc0f560bd53f90cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0f560bd53f90c5 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756048.187103:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891350390600/0xc0f560bd53f90cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0f560bd53f90c5 expref: 18 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756048.187113:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891350390600/0xc0f560bd53f90cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f90c5 expref: 18 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756048.187121:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891350390600, rc 0) 00000100:00100000:2.0:1784756048.187141:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+18:5772:x1871452237235584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756048.187145:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1784756048.187170:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e86d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237235584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784756048.187178:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff891350391200/0xc0f560bd53f90c5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f90cc expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756048.187184:0:5772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff891350391200/0xc0f560bd53f90c5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0f560bd53f90cc expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756048.187209:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e86d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237235712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784756048.187229:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756048.187240:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff89135906b000 going to sleep for 11 seconds 00000100:00100000:2.0:1784756048.187250:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237235712 00000100:00100000:2.0:1784756048.187253:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237235712 00000100:00100000:2.0:1784756048.187269:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1784756048.187274:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+18:5772:x1871452237235712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784756048.187456:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+18:5772:x1871452237235712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 182us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756048.187460:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1784756048.187479:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e86d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237235712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784756048.187499:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e86d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237235840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784756048.187529:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756048.187542:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff89135906b000 going to sleep for 11 seconds 00000100:00100000:2.0:1784756048.187551:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237235840 00000100:00100000:2.0:1784756048.187553:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237235840 00000100:00100000:2.0:1784756048.187565:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1784756048.187568:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+18:5772:x1871452237235840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784756048.187670:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+18:5772:x1871452237235840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756048.187679:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1784756048.187702:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e86d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237235840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784756048.190402:0:8411:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891374d64e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:8411:1871452237235968:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784756048.190499:0:8411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756048.190552:0:8411:0:(client.c:2702:ptlrpc_set_wait()) set ffff89137540d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784756048.190678:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237235968 00000100:00100000:1.0:1784756048.190686:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237235968 00000100:00100000:1.0:1784756048.190748:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1784756048.190758:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+18:8411:x1871452237235968:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784756048.190960:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+18:8411:x1871452237235968:12345-0@lo:502:llog_process_th.0 Request processed in 204us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756048.190968:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1784756048.191403:0:8411:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891374d64e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:8411:1871452237235968:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784756048.191463:0:8411:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784756048.191472:0:8411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784756048.191474:0:8411:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784756048.191482:0:8411:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff891342e9d800 00000020:00000080:3.0:1784756048.191485:0:8411:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784756048.191550:0:8411:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891374d64e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:8411:1871452237236096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784756048.191592:0:8411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756048.191615:0:8411:0:(client.c:2702:ptlrpc_set_wait()) set ffff891344c4c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784756048.193667:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237236096 00000100:00100000:1.0:1784756048.193678:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237236096 00000100:00100000:1.0:1784756048.193749:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1784756048.193759:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+18:8411:x1871452237236096:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784756048.194029:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+18:8411:x1871452237236096:12345-0@lo:502:llog_process_th.0 Request processed in 270us (2435us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756048.194037:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1784756048.194575:0:8411:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891374d64e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:8411:1871452237236096:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784756048.194613:0:8411:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784756048.194630:0:8411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784756048.194633:0:8411:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1784756048.194639:0:8411:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1784756048.194951:0:5772:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1784756048.194992:0:5772:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784756048.195002:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff891350391200/0xc0f560bd53f90c5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f90cc expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756048.195012:0:5772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff891350391200/0xc0f560bd53f90c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f90cc expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784756048.195022:0:5772:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784756048.195025:0:5772:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8913516af000 from 4 10000000:01000000:1.0:1784756048.195027:0:5772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784756048.195057:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff89135fc58c00/0xc0f560bd53f90d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756048.195066:0:5772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff89135fc58c00/0xc0f560bd53f90d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756048.195074:0:5772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff89135fc58c00/0xc0f560bd53f90d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756048.195095:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237236224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784756048.195139:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756048.195390:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237236224 00000100:00100000:2.0:1784756048.195396:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237236224 00000100:00100000:2.0:1784756048.195463:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1784756048.195473:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+18:5772:x1871452237236224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784756048.195484:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756048.195497:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891350390400/0xc0f560bd53f90da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0f560bd53f90d3 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756048.195517:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891350390400/0xc0f560bd53f90da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0f560bd53f90d3 expref: 19 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756048.195527:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891350390400/0xc0f560bd53f90da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f90d3 expref: 19 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756048.195535:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891350390400, rc 0) 00000100:00100000:1.0:1784756048.195735:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913754e4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784756048.197971:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a5739ad-a70a-4582-8756-59cdd498af45+19:5772:x1871452237236224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2490us (2821us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756048.197993:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1784756048.201073:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237236224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784756048.201104:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff89135fc58c00/0xc0f560bd53f90d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f90da expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756048.201117:0:5772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff89135fc58c00/0xc0f560bd53f90d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0f560bd53f90da expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756048.201567:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237236352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784756048.201639:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756048.201716:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff8913754e4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784756048.207866:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237236352 00000100:00100000:2.0:1784756048.207882:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237236352 00000100:00100000:2.0:1784756048.208080:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1784756048.208091:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+19:5772:x1871452237236352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784756048.208695:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+19:5772:x1871452237236352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 605us (7055us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756048.208806:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237236352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784756048.208867:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346763100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237236480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784756048.208919:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756048.209070:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1784756048.209891:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff89136bcaf900 going to sleep for 11 seconds 00000100:00100000:2.0:1784756048.212113:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237236480 00000100:00100000:2.0:1784756048.212127:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237236480 00000100:00100000:2.0:1784756048.212586:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1784756048.212598:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+19:5772:x1871452237236480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784756048.212874:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+19:5772:x1871452237236480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 278us (3954us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756048.212882:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1784756048.213147:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346763100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237236480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784756048.213576:0:8414:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e86d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:8414:1871452237236608:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784756048.213637:0:8414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756048.213665:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237236608 00000100:00100000:2.0:1784756048.213670:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237236608 00000100:00100000:2.0:1784756048.213692:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1784756048.213763:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+19:8414:x1871452237236608:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784756048.213916:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+19:8414:x1871452237236608:12345-0@lo:502:llog_process_th.0 Request processed in 217us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756048.214049:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1784756048.214100:0:8414:0:(client.c:2702:ptlrpc_set_wait()) set ffff891351177180 going to sleep for 11 seconds 00000100:00100000:2.0:1784756048.214117:0:8414:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e86d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:8414:1871452237236608:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784756048.214142:0:8414:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784756048.214475:0:8414:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784756048.214479:0:8414:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1784756048.214489:0:8414:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8913516af000 00000020:00000080:2.0:1784756048.214492:0:8414:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784756048.214572:0:8414:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e86d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:8414:1871452237236736:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784756048.214612:0:8414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756048.214645:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237236736 00000100:00100000:2.0:1784756048.214650:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237236736 00000100:00100000:2.0:1784756048.214670:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1784756048.214676:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+19:8414:x1871452237236736:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784756048.214883:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+19:8414:x1871452237236736:12345-0@lo:502:llog_process_th.0 Request processed in 206us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756048.214890:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1784756048.214921:0:8414:0:(client.c:2702:ptlrpc_set_wait()) set ffff891351177180 going to sleep for 11 seconds 00000100:00100000:2.0:1784756048.214949:0:8414:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e86d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3a5739ad-a70a-4582-8756-59cdd498af45:8414:1871452237236736:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784756048.214970:0:8414:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784756048.215278:0:8414:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784756048.215281:0:8414:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1784756048.215286:0:8414:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1784756048.219387:0:5772:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1784756048.219517:0:5772:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784756048.219529:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff89135fc58c00/0xc0f560bd53f90d3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f90da expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756048.219542:0:5772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff89135fc58c00/0xc0f560bd53f90d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f90da expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756048.256852:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756048.475358:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1784756048.475520:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228818560 00000100:00100000:3.0:1784756048.475530:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228818560 00000100:00100000:3.0:1784756048.475594:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 184 00000100:00100000:3.0:1784756048.475605:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+9:5565:x1871452228818560:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784756048.475637:0:5767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784756048.475657:0:5767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89134151be00/0xc0f560bd53f90e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9935e598575ac42 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756048.475687:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89134151be00/0xc0f560bd53f90e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac42 expref: 10 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756048.475698:0:5767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89134151be00/0xc0f560bd53f90e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac42 expref: 10 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756048.475707:0:5767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89134151be00, rc 0) 00000100:00100000:3.0:1784756048.475767:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+10:5565:x1871452228818560:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 Request processed in 163us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756048.475774:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 184 00000100:00100000:0.0:1784756048.485509:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1784756048.485590:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228818688 00000100:00100000:3.0:1784756048.485601:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228818688 00000100:00100000:3.0:1784756048.485686:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 185 00000100:00100000:3.0:1784756048.485696:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913466b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e891795-8b87-4754-b411-3420f9834f05+10:5565:x1871452228818688:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784756048.486159:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913466b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e891795-8b87-4754-b411-3420f9834f05+10:5565:x1871452228818688:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 Request processed in 460us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756048.486168:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 185 00000100:00100000:1.0:1784756048.494626:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1784756048.495755:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228818816 00000100:00100000:3.0:1784756048.495768:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228818816 00000100:00100000:3.0:1784756048.495828:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 186 00000100:00100000:3.0:1784756048.495839:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913466bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+10:5565:x1871452228818816:12345-192.168.202.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784756048.496598:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913466bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+10:5565:x1871452228818816:12345-192.168.202.41@tcp:503:ll_cfg_requeue.0 Request processed in 756us (1991us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756048.496609:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 186 00000100:00100000:3.0:1784756048.502202:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1784756048.502246:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228818944 00000100:00100000:3.0:1784756048.502694:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228818944 00000100:00100000:3.0:1784756048.502749:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 187 00000100:00100000:3.0:1784756048.502758:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913466b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e891795-8b87-4754-b411-3420f9834f05+10:6102:x1871452228818944:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784756048.503506:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913466b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e891795-8b87-4754-b411-3420f9834f05+10:6102:x1871452228818944:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 746us (1310us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756048.503514:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 187 00000100:00100000:1.0:1784756048.516545:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1784756048.516653:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228819072 00000100:00100000:2.0:1784756048.516667:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228819072 00000100:00100000:2.0:1784756048.516726:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 188 00000100:00100000:2.0:1784756048.516737:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913466ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+10:6102:x1871452228819072:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784756048.517116:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913466ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+10:6102:x1871452228819072:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 379us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756048.517125:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 188 00010000:00010000:2.0:1784756049.267678:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756049.715790:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3290:1871452237236992:0@lo:400:kworker.0 00000100:00100000:1.0:1784756049.715867:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756049.716130:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3a5739ad-a70a-4582-8756-59cdd498af45:3293:1871452237236864:0@lo:400:kworker.0 00000100:00100000:1.0:1784756049.716254:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237237504:0@lo:400:kworker.0 00000100:00100000:0.0:1784756049.716539:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237237248:0@lo:400:kworker.0 00000100:00100000:2.0:1784756049.719812:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756049.719885:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3293:1871452237237376:0@lo:400:kworker.0 00000100:00100000:3.0:1784756049.720848:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237236864 00000100:00100000:3.0:1784756049.720861:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237236864 00000100:00100000:2.0:1784756049.721696:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756049.722089:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1784756049.722102:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913466b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+19:3293:x1871452237236864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756049.722173:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913466b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+19:3293:x1871452237236864:12345-0@lo:400:kworker.0 Request processed in 75us (2369us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756049.722194:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1784756049.722777:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3291:1871452237237120:0@lo:400:kworker.0 00000100:00100000:1.0:1784756049.722818:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756049.722861:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237236992 00000100:00100000:1.0:1784756049.722868:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237236992 00000100:00100000:1.0:1784756049.723688:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237237376 00000100:00100000:1.0:1784756049.723695:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237237376 00000100:00100000:1.0:1784756049.723728:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237237120 00000100:00100000:1.0:1784756049.723731:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237237120 00000100:00100000:1.0:1784756049.723748:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784756049.723756:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1871452237236992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756049.723813:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1871452237236992:12345-0@lo:400:kworker.0 Request processed in 58us (7946us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756049.723829:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784756049.723843:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784756049.723848:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891353e86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1871452237237376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756049.723875:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891353e86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1871452237237376:12345-0@lo:400:kworker.0 Request processed in 28us (2182us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756049.723880:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784756049.724045:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3a5739ad-a70a-4582-8756-59cdd498af45:3293:1871452237236864:0@lo:400:kworker.0 00000100:00100000:3.0:1784756049.724065:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3293:1871452237237376:0@lo:400:kworker.0 00000100:00100000:1.0:1784756049.724112:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784756049.724122:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1871452237237120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756049.724159:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1871452237237120:12345-0@lo:400:kworker.0 Request processed in 39us (1340us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756049.725690:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1784756049.726854:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784756049.727070:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3291:1871452237237120:0@lo:400:kworker.0 00000100:00100000:1.0:1784756049.727145:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756049.727194:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3290:1871452237236992:0@lo:400:kworker.0 00000100:00100000:2.0:1784756049.727762:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237237504 00000100:00100000:2.0:1784756049.727770:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237237504 00000100:00100000:2.0:1784756049.727831:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784756049.727841:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375a82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3290:x1871452237237504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756049.728161:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375a82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3290:x1871452237237504:12345-0@lo:400:kworker.0 Request processed in 320us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756049.728169:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1784756049.728536:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784756049.728728:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375a82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3291:1871452237237632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784756049.728775:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756049.728837:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237237632 00000100:00100000:1.0:1784756049.728841:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237237632 00000100:00100000:1.0:1784756049.728870:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784756049.728876:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375a80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1871452237237632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784756049.729050:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784756049.729096:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375a80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1871452237237632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 219us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756049.729103:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1784756049.729148:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891375a82a00 x1871452237237632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756065 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756049.729166:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3291:1871452237237632:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1784756049.730483:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891375a82680 x1871452237237504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756049.730499:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237237504:0@lo:400:kworker.0 00000100:00100000:0.0:1784756049.734593:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756049.738106:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237237248 00000100:00100000:2.0:1784756049.738122:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237237248 00000100:00100000:2.0:1784756049.738209:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784756049.738220:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346761f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237237248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756049.738319:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346761f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237237248:12345-0@lo:400:kworker.0 Request processed in 101us (3733us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756049.738325:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1784756049.738456:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784756049.738510:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891375a80380 x1871452237237248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756049.738525:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237237248:0@lo:400:kworker.0 00010000:00010000:3.0:1784756050.291703:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756050.457836:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1784756050.457877:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1784756050.457902:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1784756050.457928:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1784756050.457964:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228819456 00000100:00100000:3.0:1784756050.457974:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228819456 00000100:00100000:3.0:1784756050.458028:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228819584 00000100:00100000:3.0:1784756050.458031:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228819584 00000100:00100000:3.0:1784756050.458049:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:3.0:1784756050.458059:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891374d67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:391dd9f2-6bf0-4674-aedd-25845b6bf878+5:2354:x1871452228819456:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1784756050.458132:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891374d67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:391dd9f2-6bf0-4674-aedd-25845b6bf878+5:2354:x1871452228819456:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 73us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756050.458139:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:3.0:1784756050.458158:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 17 00000100:00100000:3.0:1784756050.458164:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891374d65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:391dd9f2-6bf0-4674-aedd-25845b6bf878+5:2354:x1871452228819584:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1784756050.458186:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891374d65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:391dd9f2-6bf0-4674-aedd-25845b6bf878+5:2354:x1871452228819584:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 22us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756050.458191:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 17 00000100:00100000:3.0:1784756050.458208:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228819328 00000100:00100000:3.0:1784756050.458211:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228819328 00000100:00100000:3.0:1784756050.458237:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 31 00000100:00100000:3.0:1784756050.458255:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891374d67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2354:x1871452228819328:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1784756050.458283:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891374d67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2354:x1871452228819328:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 29us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756050.458289:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 31 00000100:00080000:3.0:1784756050.458308:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784756050.458313:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784756050.458314:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784756050.462636:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228819200 00000100:00100000:0.0:1784756050.462651:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228819200 00000100:00100000:0.0:1784756050.462731:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 190 00000100:00100000:0.0:1784756050.462742:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913466bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+10:2354:x1871452228819200:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1784756050.462827:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913466bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+10:2354:x1871452228819200:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 86us (5001us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756050.462835:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 190 00010000:00010000:0.0:1784756051.317520:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756052.277517:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346760e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237237760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784756052.277607:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756052.277686:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237237760 00000100:00100000:3.0:1784756052.277695:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237237760 00000100:00100000:3.0:1784756052.277771:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784756052.277782:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346760380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237237760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784756052.277823:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784756052.277882:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346760380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237237760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756052.277890:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1784756052.278029:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784756052.278066:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891346760e00 x1871452237237760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756068 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756052.278085:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346760e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237237760:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784756052.341800:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784756052.845548:0:8640:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1784756053.369404:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756054.392150:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756054.837279:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346760e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1871452237237888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784756054.837347:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756054.837442:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237237888 00000100:00100000:0.0:1784756054.837449:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237237888 00000100:00100000:0.0:1784756054.837500:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784756054.837509:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1871452237237888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784756054.837551:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784756054.837606:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1871452237237888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756054.837615:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1784756054.837973:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1784756054.838010:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891346760e00 x1871452237237888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756070 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756054.838027:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346760e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1871452237237888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784756054.840818:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3291:1871452237238144:0@lo:400:kworker.0 00000100:00100000:1.0:1784756054.840906:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756054.840958:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1784756054.840965:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3a5739ad-a70a-4582-8756-59cdd498af45:3291:1871452237238016:0@lo:400:kworker.0 00000100:00100000:1.0:1784756054.840995:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756054.841027:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3291:1871452237238528:0@lo:400:kworker.0 00000100:00100000:1.0:1784756054.841048:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756054.841079:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237238144 00000100:00100000:1.0:1784756054.841085:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237238144 00000100:00100000:1.0:1784756054.841337:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237238528 00000100:00100000:1.0:1784756054.841341:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237238528 00000100:00100000:1.0:1784756054.841388:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784756054.841399:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1871452237238144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756054.841407:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784756054.841434:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375a80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1871452237238528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756054.841493:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1871452237238144:12345-0@lo:400:kworker.0 Request processed in 95us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756054.841495:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375a80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1871452237238528:12345-0@lo:400:kworker.0 Request processed in 78us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756054.841504:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784756054.841523:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784756054.841557:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3291:1871452237238528:0@lo:400:kworker.0 00000100:00100000:1.0:1784756054.841580:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3291:1871452237238144:0@lo:400:kworker.0 00000100:00100000:0.0:1784756054.842024:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3292:1871452237238272:0@lo:400:kworker.0 00000100:00100000:0.0:1784756054.842065:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756054.842107:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784756054.842115:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237238400:0@lo:400:kworker.0 00000100:00100000:0.0:1784756054.842163:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784756054.842197:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784756054.842201:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237238016 00000100:00100000:3.0:1784756054.842207:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237238016 00000100:00100000:3.0:1784756054.842263:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1784756054.842271:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913466b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+19:3291:x1871452237238016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756054.842326:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913466b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+19:3291:x1871452237238016:12345-0@lo:400:kworker.0 Request processed in 56us (1330us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756054.842332:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1784756054.842362:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237238400 00000100:00100000:3.0:1784756054.842365:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237238400 00000100:00100000:3.0:1784756054.842401:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784756054.842407:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f97ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237238400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756054.842463:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f97ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237238400:12345-0@lo:400:kworker.0 Request processed in 57us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756054.842469:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1784756054.842741:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784756054.842773:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891353e84000 x1871452237238400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756054.842786:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237238400:0@lo:400:kworker.0 00000100:00100000:1.0:1784756054.846174:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237238272 00000100:00100000:1.0:1784756054.846191:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237238272 00000100:00100000:1.0:1784756054.846273:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784756054.846284:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346760e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1871452237238272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756054.846410:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346760e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1871452237238272:12345-0@lo:400:kworker.0 Request processed in 127us (4343us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756054.846434:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1784756054.846466:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784756054.846488:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3a5739ad-a70a-4582-8756-59cdd498af45:3291:1871452237238016:0@lo:400:kworker.0 00000100:00100000:0.0:1784756054.846507:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3292:1871452237238272:0@lo:400:kworker.0 00010000:00010000:2.0:1784756055.414334:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756055.578675:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1784756055.578727:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1784756055.578755:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1784756055.578785:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1784756055.578816:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228819712 00000100:00100000:3.0:1784756055.578827:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228819712 00000100:00100000:3.0:1784756055.578890:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 192 00000100:00100000:3.0:1784756055.578900:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347ad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+10:2354:x1871452228819712:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1784756055.578966:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347ad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+10:2354:x1871452228819712:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 69us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756055.578973:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 192 00000100:00100000:3.0:1784756055.579006:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228819968 00000100:00100000:3.0:1784756055.579009:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228819968 00000100:00100000:3.0:1784756055.579039:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228820096 00000100:00100000:3.0:1784756055.579042:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228820096 00000100:00100000:3.0:1784756055.579056:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 19 00000100:00100000:3.0:1784756055.579062:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891374d64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+5:2354:x1871452228819968:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1784756055.579086:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891374d64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+5:2354:x1871452228819968:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 24us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756055.579092:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 19 00000100:00100000:3.0:1784756055.579103:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 20 00000100:00100000:3.0:1784756055.579109:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+5:2354:x1871452228820096:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1784756055.579145:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+5:2354:x1871452228820096:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 36us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756055.579151:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 20 00000100:00100000:3.0:1784756055.579170:0:8296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228819840 00000100:00100000:3.0:1784756055.579173:0:8296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228819840 00000100:00100000:3.0:1784756055.579203:0:8296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 35 00000100:00100000:3.0:1784756055.579210:0:8296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891374d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2354:x1871452228819840:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1784756055.579237:0:8296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891374d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2354:x1871452228819840:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 28us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756055.579243:0:8296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 35 00000100:00080000:3.0:1784756055.579388:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784756055.579394:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784756055.579396:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784756056.437129:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756057.395840:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784756057.395864:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891375ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237238656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784756057.396149:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756057.396267:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237238656 00000100:00100000:1.0:1784756057.396275:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237238656 00000100:00100000:2.0:1784756057.396447:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784756057.396460:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1871452237238656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784756057.396496:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756057.396558:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1871452237238656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756057.396565:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1784756057.396607:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891375ee4000 x1871452237238656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756073 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756057.396627:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891375ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237238656:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1784756057.396756:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784756057.460529:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784756057.774139:0:8884:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing yml_node 00010000:00010000:2.0:1784756058.484681:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756059.507747:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756059.956580:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136f97df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237238784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784756059.956663:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756059.957324:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237238784 00000100:00100000:2.0:1784756059.957334:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237238784 00000100:00100000:2.0:1784756059.957397:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784756059.957407:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375a80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237238784:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1784756059.957441:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1784756059.957460:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756059.958920:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375a80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237238784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1504us (2247us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756059.958936:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784756059.959319:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136f97ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3a5739ad-a70a-4582-8756-59cdd498af45:3293:1871452237238912:0@lo:400:kworker.0 00000100:00100000:0.0:1784756059.959364:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756059.959408:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237238912 00000100:00100000:0.0:1784756059.959410:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136f97dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3293:1871452237239424:0@lo:400:kworker.0 00000100:00100000:3.0:1784756059.959435:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237238912 00000100:00100000:0.0:1784756059.959452:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756059.959471:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1784756059.959479:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347ad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+19:3293:x1871452237238912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756059.959528:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347ad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+19:3293:x1871452237238912:12345-0@lo:400:kworker.0 Request processed in 50us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756059.959535:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1784756059.959641:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136f97f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3290:1871452237239040:0@lo:400:kworker.0 00000100:00100000:2.0:1784756059.959670:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756059.959693:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784756059.959699:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136f97c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3290:1871452237239168:0@lo:400:kworker.0 00000100:00100000:2.0:1784756059.959730:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756059.959762:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237239424 00000100:00100000:3.0:1784756059.959788:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237239040 00000100:00100000:3.0:1784756059.959792:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237239040 00000100:00100000:3.0:1784756059.959825:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237239168 00000100:00100000:3.0:1784756059.959828:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237239168 00000100:00100000:3.0:1784756059.959854:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784756059.959860:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891353e85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1871452237239040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756059.959909:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891353e85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1871452237239040:12345-0@lo:400:kworker.0 Request processed in 49us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756059.959915:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784756059.959927:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784756059.959932:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891353e87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1871452237239168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756059.959955:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891353e87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1871452237239168:12345-0@lo:400:kworker.0 Request processed in 24us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756059.959960:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1784756059.959993:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784756059.960257:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136f97ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3a5739ad-a70a-4582-8756-59cdd498af45:3293:1871452237238912:0@lo:400:kworker.0 00000100:00100000:0.0:1784756059.960272:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784756059.960280:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136f97e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1871452237239296:0@lo:400:kworker.0 00000100:00100000:0.0:1784756059.960308:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756059.960339:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237239296 00000100:00100000:0.0:1784756059.960342:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237239296 00000100:00100000:0.0:1784756059.960375:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784756059.960381:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f97ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1871452237239296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756059.960440:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f97ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1871452237239296:12345-0@lo:400:kworker.0 Request processed in 36us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756059.960446:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1784756059.960465:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784756059.960588:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136f97c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3290:1871452237239168:0@lo:400:kworker.0 00000100:00100000:3.0:1784756059.960600:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136f97f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3290:1871452237239040:0@lo:400:kworker.0 00010000:00080000:1.0:1784756059.960673:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136f97df80 x1871452237238784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756075 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756059.960692:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136f97df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237238784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784756059.960819:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237239424 00000100:00100000:2.0:1784756059.960903:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784756059.960911:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f97ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1871452237239424:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1784756059.960921:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784756059.960950:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f97ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1871452237239424:12345-0@lo:400:kworker.0 Request processed in 40us (1497us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756059.960955:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1784756059.960989:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136f97e680 x1871452237239296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756059.960999:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136f97e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1871452237239296:0@lo:400:kworker.0 00000100:00100000:0.0:1784756059.961008:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136f97dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3293:1871452237239424:0@lo:400:kworker.0 00010000:00010000:2.0:1784756060.531653:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756060.702720:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1784756060.702771:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1784756060.703028:0:8296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228820352 00000100:00100000:1.0:1784756060.703037:0:8296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228820352 00000100:00100000:1.0:1784756060.703117:0:8296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 39 00000100:00100000:1.0:1784756060.703126:0:8296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2354:x1871452228820352:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1784756060.703202:0:8296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2354:x1871452228820352:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 77us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756060.703210:0:8296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 39 00000100:00080000:3.0:1784756060.704070:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784756060.704368:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228820224 00000100:00100000:0.0:1784756060.704376:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228820224 00000100:00100000:0.0:1784756060.704453:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 194 00000100:00100000:0.0:1784756060.704474:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347ad3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+10:2354:x1871452228820224:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1784756060.704554:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347ad3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+10:2354:x1871452228820224:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 93us (1844us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756060.704562:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 194 00000100:00100000:3.0:1784756060.721100:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1784756060.721157:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1784756060.721331:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228820480 00000100:00100000:1.0:1784756060.721342:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228820480 00000100:00100000:1.0:1784756060.721457:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228820608 00000100:00100000:1.0:1784756060.721461:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228820608 00000100:00100000:1.0:1784756060.721484:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 10 00000100:00100000:1.0:1784756060.721495:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136fa59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+5:2350:x1871452228820480:12345-192.168.202.41@tcp:9:kworker.0 00000020:00000080:1.0:1784756060.721548:0:6575:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc0f560bd53f901d 00000100:00080000:1.0:1784756060.721568:0:6575:0:(import.c:65:import_set_state_nolock()) ffff89136f52c000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784756060.721613:0:6575:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:2.0:1784756060.721716:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756060.721995:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136fa59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+2:2350:x1871452228820480:12345-192.168.202.41@tcp:9:kworker.0 Request processed in 501us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756060.722004:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 10 00000100:00100000:1.0:1784756060.722022:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 11 00000100:00100000:1.0:1784756060.722029:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136fa5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+5:2350:x1871452228820608:12345-192.168.202.41@tcp:9:kworker.0 00000020:00000080:1.0:1784756060.722044:0:6575:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc0f560bd53f9024 00000100:00080000:1.0:1784756060.722050:0:6575:0:(import.c:65:import_set_state_nolock()) ffff89137def9800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784756060.722082:0:6575:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1784756060.722293:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136fa5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+2:2350:x1871452228820608:12345-192.168.202.41@tcp:9:kworker.0 Request processed in 263us (1134us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756060.722301:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 11 00000100:00080000:3.0:1784756060.722719:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784756060.722724:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784756060.723262:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756061.555598:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756062.519853:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784756062.519879:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136f97dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3291:1871452237239552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784756062.519947:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756062.520014:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237239552 00000100:00100000:0.0:1784756062.520022:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237239552 00000100:00100000:0.0:1784756062.520086:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784756062.520096:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f97e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1871452237239552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784756062.520129:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784756062.520175:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f97e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1871452237239552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756062.520183:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1784756062.520209:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784756062.520246:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136f97dc00 x1871452237239552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756078 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756062.520264:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136f97dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3291:1871452237239552:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784756062.583829:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1784756062.613684:0:6601:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 391dd9f2-6bf0-4674-aedd-25845b6bf878 00000020:00000080:2.0:1784756062.613693:0:6601:0:(genops.c:906:class_export_put()) final put ffff89136f52b800/391dd9f2-6bf0-4674-aedd-25845b6bf878 00000020:00000080:2.0:1784756062.613719:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff89136f52b800/391dd9f2-6bf0-4674-aedd-25845b6bf878 for lustre-OST0000 00000020:00000080:2.0:1784756062.613759:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89136f52c000 for lustre-OST0000 00000001:02000400:0.0:1784756063.099388:0:9077:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.183 00010000:00010000:0.0:1784756063.605595:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756064.627557:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1784756064.669314:0:7478:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 391dd9f2-6bf0-4674-aedd-25845b6bf878 00000020:00000080:0.0:1784756064.669324:0:7478:0:(genops.c:906:class_export_put()) final put ffff89137deff800/391dd9f2-6bf0-4674-aedd-25845b6bf878 00000020:00000080:3.0:1784756064.669405:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff89137deff800/391dd9f2-6bf0-4674-aedd-25845b6bf878 for lustre-OST0001 00000020:00000080:3.0:1784756064.669488:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89137def9800 for lustre-OST0001 00000100:00100000:0.0:1784756065.075710:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784756065.075737:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136f97dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237239680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784756065.075810:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756065.075938:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237239680 00000100:00100000:1.0:1784756065.075947:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237239680 00000100:00100000:1.0:1784756065.076011:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784756065.076020:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f97d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1871452237239680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784756065.076057:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784756065.076104:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f97d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1871452237239680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756065.076110:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784756065.076145:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136fa59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3290:1871452237240064:0@lo:400:kworker.0 00000100:00100000:1.0:1784756065.076185:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1784756065.076227:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136f97dc00 x1871452237239680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756081 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756065.076278:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136f97dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237239680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784756065.076300:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784756065.076306:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136fa5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237240192:0@lo:400:kworker.0 00000100:00100000:3.0:1784756065.076313:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237240064 00000100:00100000:3.0:1784756065.076317:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237240064 00000100:00100000:1.0:1784756065.076335:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756065.076358:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784756065.076365:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375a82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1871452237240064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756065.076435:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375a82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1871452237240064:12345-0@lo:400:kworker.0 Request processed in 50us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756065.076443:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784756065.076697:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136fa58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a5739ad-a70a-4582-8756-59cdd498af45:3292:1871452237239808:0@lo:400:kworker.0 00000100:00100000:0.0:1784756065.076737:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756065.076764:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136fa59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3292:1871452237240320:0@lo:400:kworker.0 00000100:00100000:0.0:1784756065.076797:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756065.076817:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784756065.076823:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136fa5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3292:1871452237239936:0@lo:400:kworker.0 00000100:00100000:0.0:1784756065.076845:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784756065.076870:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784756065.076875:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784756065.076891:0:8296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237240320 00000100:00100000:0.0:1784756065.076895:0:8296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237240320 00000100:00100000:0.0:1784756065.076924:0:8296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237239936 00000100:00100000:0.0:1784756065.076927:0:8296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237239936 00000100:00100000:0.0:1784756065.076943:0:8296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784756065.076949:0:8296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f97e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1871452237240320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756065.076986:0:8296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f97e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1871452237240320:12345-0@lo:400:kworker.0 Request processed in 36us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756065.076992:0:8296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784756065.077008:0:8296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784756065.077014:0:8296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f97fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1871452237239936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756065.077041:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136fa59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3290:1871452237240064:0@lo:400:kworker.0 00000100:00100000:0.0:1784756065.077041:0:8296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f97fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1871452237239936:12345-0@lo:400:kworker.0 Request processed in 28us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756065.077047:0:8296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1784756065.077068:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784756065.077083:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136fa5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3292:1871452237239936:0@lo:400:kworker.0 00000100:00100000:1.0:1784756065.077093:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136fa59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3292:1871452237240320:0@lo:400:kworker.0 00000100:00100000:1.0:1784756065.077119:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237240192 00000100:00100000:1.0:1784756065.077122:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237240192 00000100:00100000:1.0:1784756065.077153:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784756065.077158:0:6575:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1784756065.077158:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375a83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3290:x1871452237240192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756065.077166:0:6575:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1784756065.077211:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375a83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3290:x1871452237240192:12345-0@lo:400:kworker.0 Request processed in 52us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756065.077217:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1784756065.077230:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784756065.077245:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136fa5ad80 x1871452237240192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756065.077256:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136fa5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237240192:0@lo:400:kworker.0 00000100:00100000:3.0:1784756065.077444:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237239808 00000100:00100000:3.0:1784756065.077449:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237239808 00000100:00100000:3.0:1784756065.077493:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1784756065.077500:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347ad1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+19:3292:x1871452237239808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756065.077534:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347ad1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+19:3292:x1871452237239808:12345-0@lo:400:kworker.0 Request processed in 34us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756065.077541:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1784756065.078546:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136fa58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a5739ad-a70a-4582-8756-59cdd498af45:3292:1871452237239808:0@lo:400:kworker.0 00010000:00010000:0.0:1784756065.655644:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756065.818241:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1784756065.818284:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1784756065.818343:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228820864 00000100:00100000:1.0:1784756065.818353:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228820864 00000100:00100000:1.0:1784756065.818571:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 43 00000100:00100000:1.0:1784756065.818587:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f97f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2354:x1871452228820864:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1784756065.818664:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f97f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2354:x1871452228820864:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 79us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756065.818672:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 43 00000100:00100000:3.0:1784756065.818757:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228820736 00000100:00100000:3.0:1784756065.818760:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228820736 00000100:00100000:3.0:1784756065.818787:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 196 00000100:00100000:3.0:1784756065.818793:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347ad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+10:2354:x1871452228820736:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1784756065.818818:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347ad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+10:2354:x1871452228820736:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 26us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756065.818834:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 196 00000100:00080000:0.0:1784756065.819191:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1784756065.995885:0:9177:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.183 00010000:00010000:1.0:1784756066.675951:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756067.636682:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784756067.636708:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136fa58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237240448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784756067.636787:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756067.637190:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237240448 00000100:00100000:2.0:1784756067.637199:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237240448 00000100:00100000:2.0:1784756067.637272:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784756067.637282:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375a83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237240448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784756067.637330:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756067.637397:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375a83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237240448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756067.637404:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1784756067.637503:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784756067.637546:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136fa58e00 x1871452237240448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756083 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756067.637568:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136fa58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237240448:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784756067.699731:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756068.726510:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784756068.895307:0:9276:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.183 00010000:00010000:1.0:1784756069.747580:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756070.195534:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89134687a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237240576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784756070.195599:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756070.197403:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3292:1871452237240832:0@lo:400:kworker.0 00000100:00100000:1.0:1784756070.197488:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756070.197521:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784756070.197526:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89134687aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3292:1871452237240960:0@lo:400:kworker.0 00000100:00100000:1.0:1784756070.197544:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756070.197588:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237240832 00000100:00100000:1.0:1784756070.197595:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237240832 00000100:00100000:1.0:1784756070.197639:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237240960 00000100:00100000:1.0:1784756070.197642:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237240960 00000100:00100000:1.0:1784756070.197670:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784756070.197678:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913585cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1871452237240832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756070.197737:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913585cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1871452237240832:12345-0@lo:400:kworker.0 Request processed in 60us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756070.197745:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784756070.197760:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784756070.197766:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913585cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1871452237240960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756070.197800:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913585cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1871452237240960:12345-0@lo:400:kworker.0 Request processed in 35us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756070.197806:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1784756070.197823:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784756070.197850:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89134687aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3292:1871452237240960:0@lo:400:kworker.0 00000100:00100000:1.0:1784756070.197859:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3292:1871452237240832:0@lo:400:kworker.0 00000100:00100000:3.0:1784756070.198466:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89134687b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237241088:0@lo:400:kworker.0 00000100:00100000:3.0:1784756070.198509:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756070.198546:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1784756070.198552:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89134687bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a5739ad-a70a-4582-8756-59cdd498af45:3290:1871452237240704:0@lo:400:kworker.0 00000100:00100000:3.0:1784756070.198579:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756070.198602:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891346878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3290:1871452237241216:0@lo:400:kworker.0 00000100:00100000:3.0:1784756070.198636:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756070.198663:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237240704 00000100:00100000:3.0:1784756070.198668:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237240704 00000100:00100000:3.0:1784756070.198705:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1784756070.198712:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347ad0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+19:3290:x1871452237240704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756070.198753:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347ad0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+19:3290:x1871452237240704:12345-0@lo:400:kworker.0 Request processed in 41us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756070.198760:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1784756070.198882:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237241088 00000100:00100000:1.0:1784756070.198886:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237241088 00000100:00100000:1.0:1784756070.198923:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784756070.198930:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136fa5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3290:x1871452237241088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756070.198965:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136fa5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3290:x1871452237241088:12345-0@lo:400:kworker.0 Request processed in 36us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756070.198971:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784756070.198990:0:8296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237241216 00000100:00100000:1.0:1784756070.198993:0:8296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237241216 00000100:00100000:1.0:1784756070.199017:0:8296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784756070.199023:0:8296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136fa58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1871452237241216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756070.199051:0:8296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136fa58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1871452237241216:12345-0@lo:400:kworker.0 Request processed in 29us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756070.199057:0:8296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1784756070.199086:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784756070.199090:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784756070.199249:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237240576 00000100:00100000:2.0:1784756070.199254:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237240576 00000100:00100000:2.0:1784756070.199288:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784756070.199486:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89134687bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a5739ad-a70a-4582-8756-59cdd498af45:3290:1871452237240704:0@lo:400:kworker.0 00000100:00100000:3.0:1784756070.199500:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891346878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3290:1871452237241216:0@lo:400:kworker.0 00010000:00080000:3.0:1784756070.199511:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89134687b800 x1871452237241088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756070.199521:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89134687b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237241088:0@lo:400:kworker.0 00000100:00080000:1.0:1784756070.199897:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784756070.199965:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134687ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1871452237240576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784756070.199998:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756070.200056:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134687ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1871452237240576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 762us (4456us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756070.200063:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1784756070.200245:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89134687a300 x1871452237240576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756086 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756070.200263:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89134687a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237240576:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1784756070.401014:0:9324:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity ============----- Wed Jul 22 17:34:29 EDT 2026 00010000:00010000:2.0:1784756070.771768:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756070.943650:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1784756070.943714:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1784756070.943763:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228821120 00000100:00100000:0.0:1784756070.943788:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228821120 00000100:00100000:0.0:1784756070.943862:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 47 00000100:00100000:0.0:1784756070.943872:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f97c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2351:x1871452228821120:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1784756070.943957:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f97c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2351:x1871452228821120:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 88us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756070.943966:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 47 00000100:00080000:0.0:1784756070.943990:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784756070.945051:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228820992 00000100:00100000:3.0:1784756070.945064:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228820992 00000100:00100000:3.0:1784756070.945126:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 198 00000100:00100000:3.0:1784756070.945135:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347ad3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+10:2351:x1871452228820992:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1784756070.945196:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347ad3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+10:2351:x1871452228820992:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 62us (1560us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756070.945202:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 198 00010000:00010000:1.0:1784756071.797007:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756072.755659:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784756072.755684:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136fa5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1871452237241344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784756072.755757:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756072.755980:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237241344 00000100:00100000:0.0:1784756072.755987:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237241344 00000100:00100000:0.0:1784756072.756054:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784756072.756065:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136fa59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1871452237241344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784756072.756100:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784756072.756152:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136fa59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1871452237241344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756072.756158:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1784756072.756767:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784756072.756810:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136fa5a680 x1871452237241344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756088 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756072.756843:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136fa5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1871452237241344:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784756072.829485:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756073.843704:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756074.867857:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756075.315768:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784756075.316020:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8913585ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a5739ad-a70a-4582-8756-59cdd498af45:3292:1871452237241472:0@lo:400:kworker.0 00000100:00100000:1.0:1784756075.316103:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756075.316193:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237241472 00000100:00100000:1.0:1784756075.316201:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237241472 00000100:00100000:1.0:1784756075.316246:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1784756075.316255:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347ad1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+19:3292:x1871452237241472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756075.316308:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347ad1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+19:3292:x1871452237241472:12345-0@lo:400:kworker.0 Request processed in 53us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756075.316316:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1784756075.316361:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8913585ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a5739ad-a70a-4582-8756-59cdd498af45:3292:1871452237241472:0@lo:400:kworker.0 00000100:00100000:1.0:1784756075.316452:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8913585cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237241856:0@lo:400:kworker.0 00000100:00100000:1.0:1784756075.316479:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756075.317036:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8913585ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3290:1871452237241600:0@lo:400:kworker.0 00000100:00100000:2.0:1784756075.318988:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8913585cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3291:1871452237241728:0@lo:400:kworker.0 00000100:00100000:3.0:1784756075.319905:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756075.320276:0:8296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237241600 00000100:00100000:3.0:1784756075.320284:0:8296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237241600 00000100:00100000:3.0:1784756075.320442:0:8296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784756075.320454:0:8296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136fa5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1871452237241600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756075.320527:0:8296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136fa5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1871452237241600:12345-0@lo:400:kworker.0 Request processed in 76us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756075.320534:0:8296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784756075.320585:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136fa58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1871452237241984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784756075.320624:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756075.320663:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237241984 00000100:00100000:3.0:1784756075.320668:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237241984 00000100:00100000:3.0:1784756075.320706:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784756075.320713:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136fa59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1871452237241984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784756075.320738:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784756075.320829:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136fa59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1871452237241984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756075.320850:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1784756075.320868:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1784756075.321530:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136fa58a80 x1871452237241984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756091 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756075.321550:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136fa58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1871452237241984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784756075.321580:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8913585ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3290:1871452237241600:0@lo:400:kworker.0 00000100:00100000:1.0:1784756075.322957:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8913585cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3290:1871452237242112:0@lo:400:kworker.0 00000100:00100000:1.0:1784756075.323085:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756075.327049:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237241856 00000100:00100000:3.0:1784756075.327064:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237241856 00000100:00100000:3.0:1784756075.327688:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1784756075.327954:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784756075.328233:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913585ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237241856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756075.328403:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913585ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237241856:12345-0@lo:400:kworker.0 Request processed in 176us (11920us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756075.328413:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784756075.329650:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237242112 00000100:00100000:2.0:1784756075.329662:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237242112 00000100:00100000:2.0:1784756075.329901:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784756075.329913:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913585cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1871452237242112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756075.330060:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913585cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1871452237242112:12345-0@lo:400:kworker.0 Request processed in 150us (6974us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756075.330068:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784756075.330659:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756075.330689:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237241728 00000100:00100000:2.0:1784756075.330695:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237241728 00000100:00100000:2.0:1784756075.330800:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784756075.330808:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891353e85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1871452237241728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756075.330848:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891353e85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1871452237241728:12345-0@lo:400:kworker.0 Request processed in 42us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756075.330855:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784756075.330905:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8913585cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3291:1871452237241728:0@lo:400:kworker.0 00010000:00080000:1.0:1784756075.336234:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8913585cce00 x1871452237241856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756075.336256:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8913585cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237241856:0@lo:400:kworker.0 00000100:00100000:1.0:1784756075.336316:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8913585cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3290:1871452237242112:0@lo:400:kworker.0 00000100:00080000:1.0:1784756075.336335:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784756075.895501:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756076.070313:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1784756076.070452:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228821248 00000100:00100000:3.0:1784756076.070463:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228821248 00000100:00100000:3.0:1784756076.070530:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 200 00000100:00100000:3.0:1784756076.070540:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347ad2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+10:2354:x1871452228821248:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1784756076.070610:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1784756076.070624:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347ad2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+10:2354:x1871452228821248:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 86us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756076.070632:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 200 00000100:00100000:2.0:1784756076.070818:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228821376 00000100:00100000:2.0:1784756076.070823:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228821376 00000100:00100000:2.0:1784756076.070927:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 51 00000100:00100000:2.0:1784756076.070935:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f97d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2354:x1871452228821376:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1784756076.070991:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f97d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2354:x1871452228821376:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 57us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756076.070998:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 51 00000100:00080000:1.0:1784756076.071156:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784756076.917532:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756077.875877:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136f97ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3291:1871452237242240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784756077.875957:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756077.876250:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237242240 00000100:00100000:0.0:1784756077.876260:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237242240 00000100:00100000:0.0:1784756077.876330:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784756077.876341:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891353e84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1871452237242240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784756077.876394:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784756077.876472:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891353e84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1871452237242240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756077.876480:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1784756077.876528:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136f97ea00 x1871452237242240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756093 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756077.876568:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136f97ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3291:1871452237242240:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1784756077.876703:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784756077.947498:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756078.964401:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756079.988197:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756080.435884:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136fa58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237242368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784756080.435963:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756080.436431:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237242368 00000100:00100000:2.0:1784756080.436440:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237242368 00000100:00100000:2.0:1784756080.436502:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784756080.436524:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913585cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237242368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784756080.436567:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1784756080.443611:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784756080.446568:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913585cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237242368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 10037us (10595us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756080.446583:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1784756080.451760:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136fa58a80 x1871452237242368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756096 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756080.451791:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136fa58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237242368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784756080.451916:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8913585cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3a5739ad-a70a-4582-8756-59cdd498af45:3293:1871452237242496:0@lo:400:kworker.0 00000100:00100000:3.0:1784756080.451988:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756080.456629:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237242496 00000100:00100000:2.0:1784756080.456655:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237242496 00000100:00100000:2.0:1784756080.456727:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1784756080.456737:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+19:3293:x1871452237242496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756080.457977:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+19:3293:x1871452237242496:12345-0@lo:400:kworker.0 Request processed in 1237us (5984us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756080.458000:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1784756080.459567:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8913585cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3290:1871452237242624:0@lo:400:kworker.0 00000100:00100000:1.0:1784756080.459637:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756080.459689:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784756080.459696:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8913585cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3290:1871452237242752:0@lo:400:kworker.0 00000100:00100000:1.0:1784756080.459715:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756080.459753:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8913585ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237242880:0@lo:400:kworker.0 00000100:00100000:1.0:1784756080.459778:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756080.459799:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784756080.459803:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89134687a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3292:1871452237243008:0@lo:400:kworker.0 00000100:00100000:1.0:1784756080.459822:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756080.459850:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237242880 00000100:00100000:1.0:1784756080.459857:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237242880 00000100:00100000:1.0:1784756080.459920:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784756080.459930:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134687bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237242880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756080.459988:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134687bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237242880:12345-0@lo:400:kworker.0 Request processed in 59us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756080.459994:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784756080.460032:0:8296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237242624 00000100:00100000:1.0:1784756080.460037:0:8296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237242624 00000100:00100000:1.0:1784756080.460063:0:8296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237242752 00000100:00100000:1.0:1784756080.460065:0:8296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237242752 00000100:00100000:1.0:1784756080.460085:0:8296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237243008 00000100:00100000:1.0:1784756080.460088:0:8296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237243008 00000100:00100000:1.0:1784756080.460103:0:8296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784756080.460108:0:8296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134687b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1871452237242624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756080.460144:0:8296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134687b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1871452237242624:12345-0@lo:400:kworker.0 Request processed in 35us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756080.460150:0:8296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784756080.460162:0:8296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784756080.460167:0:8296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1871452237242752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756080.460193:0:8296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1871452237242752:12345-0@lo:400:kworker.0 Request processed in 26us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756080.460199:0:8296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784756080.460749:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784756080.460759:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1871452237243008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756080.460798:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1871452237243008:12345-0@lo:400:kworker.0 Request processed in 43us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756080.460804:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784756080.463447:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8913585cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3290:1871452237242752:0@lo:400:kworker.0 00000100:00100000:1.0:1784756080.463468:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8913585cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3290:1871452237242624:0@lo:400:kworker.0 00000100:00080000:1.0:1784756080.463496:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784756080.463502:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784756080.463720:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89134687a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3292:1871452237243008:0@lo:400:kworker.0 00010000:00080000:1.0:1784756080.463735:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8913585ced80 x1871452237242880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756096 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756080.463745:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8913585ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237242880:0@lo:400:kworker.0 00000100:00100000:3.0:1784756080.465380:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8913585cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3a5739ad-a70a-4582-8756-59cdd498af45:3293:1871452237242496:0@lo:400:kworker.0 00010000:00010000:0.0:1784756081.012482:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756081.180369:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1784756081.180469:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1784756081.180541:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228821504 00000100:00100000:3.0:1784756081.180552:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228821504 00000100:00100000:3.0:1784756081.180607:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 202 00000100:00100000:3.0:1784756081.180617:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e891795-8b87-4754-b411-3420f9834f05+10:2353:x1871452228821504:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1784756081.180716:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228821632 00000100:00100000:2.0:1784756081.180722:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228821632 00000100:00100000:2.0:1784756081.180773:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 55 00000100:00100000:2.0:1784756081.180781:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134687a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2353:x1871452228821632:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1784756081.180851:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134687a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2353:x1871452228821632:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 71us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756081.180859:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 55 00000100:00100000:3.0:1784756081.180893:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e891795-8b87-4754-b411-3420f9834f05+10:2353:x1871452228821504:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 276us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756081.180903:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 202 00000100:00080000:1.0:1784756081.181187:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784756082.040904:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756083.008138:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136f97ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237243136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784756083.008211:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756083.008296:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237243136 00000100:00100000:0.0:1784756083.008315:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237243136 00000100:00100000:0.0:1784756083.008376:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784756083.008386:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f97c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1871452237243136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784756083.008446:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784756083.008490:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f97c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1871452237243136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756083.008498:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1784756083.008523:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784756083.008568:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136f97ea00 x1871452237243136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756099 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756083.008586:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136f97ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237243136:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784756083.059594:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756084.083587:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756085.110450:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756085.556738:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136fa5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3291:1871452237243264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784756085.556838:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756085.556957:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237243264 00000100:00100000:1.0:1784756085.556966:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237243264 00000100:00100000:1.0:1784756085.557078:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784756085.557090:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136fa5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1871452237243264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784756085.557130:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784756085.557183:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136fa5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1871452237243264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756085.557192:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784756085.557232:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136f97d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3290:1871452237243648:0@lo:400:kworker.0 00000100:00100000:0.0:1784756085.557250:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136f97ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a5739ad-a70a-4582-8756-59cdd498af45:3292:1871452237243392:0@lo:400:kworker.0 00000100:00100000:1.0:1784756085.557260:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756085.557299:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784756085.557305:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136f97dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237243776:0@lo:400:kworker.0 00000100:00100000:1.0:1784756085.557330:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756085.557365:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237243648 00000100:00100000:0.0:1784756085.557368:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756085.557369:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237243648 00000100:00100000:0.0:1784756085.557395:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136f97df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3292:1871452237243904:0@lo:400:kworker.0 00000100:00100000:0.0:1784756085.557450:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756085.557471:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784756085.557476:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136f97f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3292:1871452237243520:0@lo:400:kworker.0 00000100:00100000:0.0:1784756085.557496:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756085.557523:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237243392 00000100:00100000:0.0:1784756085.557533:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237243392 00000100:00100000:0.0:1784756085.557577:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1784756085.557585:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+19:3292:x1871452237243392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756085.557624:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+19:3292:x1871452237243392:12345-0@lo:400:kworker.0 Request processed in 40us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756085.557862:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1784756085.557905:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237243904 00000100:00100000:0.0:1784756085.557909:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237243904 00000100:00080000:3.0:1784756085.559581:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784756085.559590:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784756085.559619:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237243776 00000100:00100000:3.0:1784756085.559627:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237243776 00000100:00100000:3.0:1784756085.559699:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784756085.559709:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913585cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3290:x1871452237243776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756085.559808:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913585cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3290:x1871452237243776:12345-0@lo:400:kworker.0 Request processed in 101us (2476us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756085.559815:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1784756085.559864:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136f97dc00 x1871452237243776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756085.559880:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136f97dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237243776:0@lo:400:kworker.0 00010000:00080000:3.0:1784756085.559914:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136fa5a300 x1871452237243264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756101 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756085.559930:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136fa5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3291:1871452237243264:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1784756085.559967:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784756085.560483:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237243520 00000100:00100000:0.0:1784756085.560489:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237243520 00000100:00100000:0.0:1784756085.560512:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784756085.560521:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f97f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1871452237243904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756085.560580:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f97f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1871452237243904:12345-0@lo:400:kworker.0 Request processed in 60us (3129us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756085.560587:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784756085.560605:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784756085.560611:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f97c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1871452237243520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756085.560654:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f97c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1871452237243520:12345-0@lo:400:kworker.0 Request processed in 44us (3157us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756085.560660:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784756085.560710:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136f97f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3292:1871452237243520:0@lo:400:kworker.0 00000100:00100000:0.0:1784756085.560723:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136f97ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a5739ad-a70a-4582-8756-59cdd498af45:3292:1871452237243392:0@lo:400:kworker.0 00000100:00100000:0.0:1784756085.560733:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136f97df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3292:1871452237243904:0@lo:400:kworker.0 00000100:00100000:1.0:1784756085.561210:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784756085.561219:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134687aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1871452237243648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756085.561267:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134687aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1871452237243648:12345-0@lo:400:kworker.0 Request processed in 49us (4005us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756085.561274:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784756085.561522:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136f97d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3290:1871452237243648:0@lo:400:kworker.0 00010000:00010000:2.0:1784756086.132834:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756086.297755:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1784756086.297818:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1784756086.298496:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228821760 00000100:00100000:1.0:1784756086.298516:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228821760 00000100:00100000:1.0:1784756086.298575:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 204 00000100:00100000:1.0:1784756086.298592:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+10:2353:x1871452228821760:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1784756086.298708:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+10:2353:x1871452228821760:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 118us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756086.298721:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 204 00000100:00100000:0.0:1784756086.299284:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228821888 00000100:00100000:0.0:1784756086.299291:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228821888 00000100:00080000:3.0:1784756086.299350:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784756086.299357:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 59 00000100:00100000:0.0:1784756086.299377:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136fa5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2353:x1871452228821888:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1784756086.299458:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136fa5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2353:x1871452228821888:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 83us (1715us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756086.299465:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 59 00010000:00010000:0.0:1784756087.172201:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784756087.833582:0:10052:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: - need MDS1_VERSION <= 2.16.61-1-g89cf292a8c2 (34682551 <= 34618625) for LU-18938, skip 360 00000100:00100000:2.0:1784756088.121550:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784756088.121576:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237244032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784756088.121722:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756088.121787:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237244032 00000100:00100000:2.0:1784756088.121794:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237244032 00000100:00100000:2.0:1784756088.121926:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784756088.121935:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891353e86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237244032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784756088.121973:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756088.122019:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891353e86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237244032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756088.122026:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1784756088.122080:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891353e84e00 x1871452237244032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756104 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756088.122099:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237244032:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1784756088.122399:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784756088.180714:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756089.203773:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784756089.343583:0:10101:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: - need MDS1_VERSION < v2_14_55-100-g8a84c7f9c7 (34682551 < 34486116) for LU-14927, skip 0f 00010000:00010000:0.0:1784756090.232451:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756090.676288:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136fa5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a5739ad-a70a-4582-8756-59cdd498af45:3290:1871452237244160:0@lo:400:kworker.0 00000100:00100000:3.0:1784756090.676367:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756090.676439:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136fa58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3290:1871452237244672:0@lo:400:kworker.0 00000100:00100000:3.0:1784756090.676464:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756090.676487:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1784756090.676492:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136fa58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3290:1871452237244288:0@lo:400:kworker.0 00000100:00100000:3.0:1784756090.676510:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756090.676527:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136fa5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237244800:0@lo:400:kworker.0 00000100:00100000:3.0:1784756090.676548:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756090.676578:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136fa58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3292:1871452237244416:0@lo:400:kworker.0 00000100:00100000:3.0:1784756090.676624:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756090.676643:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784756090.676649:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136fa58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237244544:0@lo:400:kworker.0 00000100:00100000:3.0:1784756090.676672:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756090.676704:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237244672 00000100:00100000:3.0:1784756090.676710:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237244672 00000100:00100000:3.0:1784756090.676758:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237244288 00000100:00100000:3.0:1784756090.676761:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237244288 00000100:00100000:3.0:1784756090.676780:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237244416 00000100:00100000:3.0:1784756090.676783:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237244416 00000100:00100000:3.0:1784756090.676810:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784756090.676817:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136fa59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1871452237244672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756090.676866:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136fa59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1871452237244672:12345-0@lo:400:kworker.0 Request processed in 49us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756090.676874:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784756090.676892:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1784756090.676898:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136fa5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1871452237244288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756090.676925:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136fa5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1871452237244288:12345-0@lo:400:kworker.0 Request processed in 27us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756090.676931:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1784756090.676942:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1784756090.676947:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136cb60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1871452237244416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756090.676977:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136cb60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1871452237244416:12345-0@lo:400:kworker.0 Request processed in 29us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756090.676983:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1784756090.677018:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237244800 00000100:00100000:3.0:1784756090.677022:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237244800 00000100:00100000:3.0:1784756090.677047:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237244544 00000100:00100000:3.0:1784756090.677050:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237244544 00000100:00100000:3.0:1784756090.677071:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784756090.677077:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136fa59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3290:x1871452237244800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756090.677108:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136fa59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3290:x1871452237244800:12345-0@lo:400:kworker.0 Request processed in 31us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756090.677114:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784756090.677125:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784756090.677132:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136cb61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237244544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756090.677168:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136cb61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237244544:12345-0@lo:400:kworker.0 Request processed in 37us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756090.677174:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1784756090.677192:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784756090.677195:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784756090.677197:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1784756090.677231:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136fa58e00 x1871452237244544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756090.677256:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136fa58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237244544:0@lo:400:kworker.0 00000100:00100000:3.0:1784756090.677268:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136fa58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3292:1871452237244416:0@lo:400:kworker.0 00000100:00100000:3.0:1784756090.677296:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136fa58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3290:1871452237244288:0@lo:400:kworker.0 00010000:00080000:3.0:1784756090.677305:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136fa5ad80 x1871452237244800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756090.677314:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136fa5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237244800:0@lo:400:kworker.0 00000100:00100000:3.0:1784756090.677323:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136fa58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3290:1871452237244672:0@lo:400:kworker.0 00000100:00100000:0.0:1784756090.678038:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237244160 00000100:00100000:0.0:1784756090.678044:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237244160 00000100:00100000:0.0:1784756090.678075:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1784756090.678082:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+19:3290:x1871452237244160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756090.678128:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+19:3290:x1871452237244160:12345-0@lo:400:kworker.0 Request processed in 46us (1761us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756090.678134:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1784756090.678186:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136fa5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a5739ad-a70a-4582-8756-59cdd498af45:3290:1871452237244160:0@lo:400:kworker.0 00000100:00100000:1.0:1784756090.678253:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784756090.678265:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136f97df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1871452237244928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784756090.678298:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756090.678367:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237244928 00000100:00100000:0.0:1784756090.678371:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237244928 00000100:00100000:0.0:1784756090.678407:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784756090.678441:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913585ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1871452237244928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784756090.678471:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784756090.678507:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913585ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1871452237244928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756090.678513:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1784756090.678704:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136f97df80 x1871452237244928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756106 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756090.678721:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136f97df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1871452237244928:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1784756090.787382:0:10149:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: - need OST1_VERSION < v2_17_50-410-gbd8e7b9555 (34682551 < 34681754) for LU-12550, skip 216 00010000:00010000:1.0:1784756091.253167:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756091.424124:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1784756091.424177:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1784756091.424507:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228822016 00000100:00100000:1.0:1784756091.424518:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228822016 00000100:00100000:1.0:1784756091.424578:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 206 00000100:00100000:1.0:1784756091.424777:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+10:2354:x1871452228822016:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1784756091.424866:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+10:2354:x1871452228822016:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 94us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756091.424920:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228822144 00000100:00100000:0.0:1784756091.424926:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228822144 00000100:00100000:0.0:1784756091.424974:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 63 00000100:00100000:0.0:1784756091.424982:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136cb62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2354:x1871452228822144:12345-192.168.202.41@tcp:400:kworker.0 00000100:00080000:2.0:1784756091.425189:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784756091.425387:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136cb62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2354:x1871452228822144:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 405us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756091.425395:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 63 00000100:00100000:1.0:1784756091.427842:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 206 00010000:00010000:0.0:1784756092.277857:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784756092.392035:0:10197:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 42a 42c 42b 118c 118d 407 119i 216 817 411a 130b 130c 130d 130e 130f 130g 00000100:00100000:0.0:1784756093.235979:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784756093.236004:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136f97ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237245056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784756093.236072:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756093.236137:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237245056 00000100:00100000:0.0:1784756093.236145:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237245056 00000100:00100000:0.0:1784756093.236199:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784756093.236229:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f97f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237245056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784756093.236263:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784756093.236309:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f97f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237245056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (237us total) trans 0 rc 0/0 00000100:00080000:2.0:1784756093.236310:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784756093.236316:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1784756093.236359:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136f97ea00 x1871452237245056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756109 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756093.236377:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136f97ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237245056:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784756093.301909:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784756093.711501:0:10246:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: skipping tests SLOW=no: 27m 60i 64b 68 71 135 136 230d 300o 842 51b 51c 51e 834 00010000:00010000:1.0:1784756094.325810:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784756095.225751:0:10294:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity: start setup 17:34:54 (1784756094) === 00010000:00010000:0.0:1784756095.365790:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756095.797546:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136f97ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237245184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784756095.797623:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756095.798954:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237245184 00000100:00100000:0.0:1784756095.798964:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237245184 00000100:00080000:2.0:1784756095.799018:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784756095.799035:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784756095.799045:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913585cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1871452237245184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784756095.799076:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784756095.799135:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913585cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1871452237245184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (1511us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756095.799154:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1784756095.799569:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136f97ea00 x1871452237245184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756111 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756095.799590:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136f97ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237245184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784756095.799612:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237245696:0@lo:400:kworker.0 00000100:00100000:0.0:1784756095.799643:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756095.799673:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1784756095.799679:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a5739ad-a70a-4582-8756-59cdd498af45:3290:1871452237245312:0@lo:400:kworker.0 00000100:00100000:0.0:1784756095.799704:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756095.799725:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3290:1871452237245824:0@lo:400:kworker.0 00000100:00100000:0.0:1784756095.799748:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756095.799777:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3292:1871452237245440:0@lo:400:kworker.0 00000100:00100000:0.0:1784756095.799798:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756095.799814:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784756095.799819:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3292:1871452237245568:0@lo:400:kworker.0 00000100:00100000:2.0:1784756095.799837:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237245696 00000100:00100000:0.0:1784756095.799839:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756095.799841:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237245696 00000100:00100000:0.0:1784756095.799862:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237245312 00000100:00100000:0.0:1784756095.799865:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237245312 00000100:00100000:2.0:1784756095.799875:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784756095.799882:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f97ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3290:x1871452237245696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756095.799886:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1784756095.799890:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+19:3290:x1871452237245312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756095.799922:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f97ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3290:x1871452237245696:12345-0@lo:400:kworker.0 Request processed in 41us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756095.799929:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1784756095.799943:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784756095.799977:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237245824 00000100:00100000:2.0:1784756095.799980:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237245824 00000100:00100000:2.0:1784756095.800007:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237245440 00000100:00100000:2.0:1784756095.800010:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237245440 00000100:00100000:2.0:1784756095.800026:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237245568 00000100:00100000:2.0:1784756095.800028:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237245568 00000100:00100000:2.0:1784756095.800042:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784756095.800047:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f97df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1871452237245824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756095.800077:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f97df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1871452237245824:12345-0@lo:400:kworker.0 Request processed in 31us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756095.800095:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784756095.800107:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1784756095.800122:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f97d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1871452237245440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756095.800153:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f97d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1871452237245440:12345-0@lo:400:kworker.0 Request processed in 31us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756095.800159:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1784756095.800170:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1784756095.800176:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f97dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1871452237245568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756095.800212:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f97dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1871452237245568:12345-0@lo:400:kworker.0 Request processed in 35us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756095.800218:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1784756095.800241:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784756095.800537:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3a5739ad-a70a-4582-8756-59cdd498af45+19:3290:x1871452237245312:12345-0@lo:400:kworker.0 Request processed in 646us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756095.800544:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1784756095.800583:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3292:1871452237245568:0@lo:400:kworker.0 00000100:00100000:0.0:1784756095.800603:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3292:1871452237245440:0@lo:400:kworker.0 00000100:00100000:0.0:1784756095.800624:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a5739ad-a70a-4582-8756-59cdd498af45:3290:1871452237245312:0@lo:400:kworker.0 00000100:00100000:0.0:1784756095.800631:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3290:1871452237245824:0@lo:400:kworker.0 00010000:00080000:0.0:1784756095.800640:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891353e85880 x1871452237245696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756095.800648:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237245696:0@lo:400:kworker.0 00010000:00010000:0.0:1784756096.374224:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756096.537311:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1784756096.537357:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1784756096.537391:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228822400 00000100:00100000:2.0:1784756096.537401:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228822400 00000100:00100000:2.0:1784756096.537491:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 67 00000100:00100000:2.0:1784756096.537502:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891353e84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2354:x1871452228822400:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1784756096.537598:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891353e84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2354:x1871452228822400:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 97us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756096.537606:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 67 00000100:00080000:2.0:1784756096.537629:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784756096.537773:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228822272 00000100:00100000:3.0:1784756096.537778:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228822272 00000100:00100000:3.0:1784756096.537816:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 208 00000100:00100000:3.0:1784756096.537824:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e891795-8b87-4754-b411-3420f9834f05+10:2354:x1871452228822272:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1784756096.537857:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e891795-8b87-4754-b411-3420f9834f05+10:2354:x1871452228822272:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 34us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756096.537863:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 208 00010000:00010000:1.0:1784756097.401635:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756098.357223:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784756098.357249:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136fa4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1871452237245952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784756098.357316:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756098.357382:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237245952 00000100:00100000:2.0:1784756098.357390:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237245952 00000100:00100000:2.0:1784756098.357491:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784756098.357501:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891353e85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1871452237245952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784756098.357543:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756098.357586:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891353e85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1871452237245952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756098.357593:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1784756098.357634:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136fa4a300 x1871452237245952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756114 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756098.357652:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136fa4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1871452237245952:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784756098.357691:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784756098.422127:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756099.443679:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756100.469848:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756100.917495:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784756100.917527:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136cb63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237246080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784756100.917596:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756100.917664:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237246080 00000100:00100000:3.0:1784756100.917672:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237246080 00000100:00100000:3.0:1784756100.917729:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784756100.917739:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136cb63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237246080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784756100.917771:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784756100.917811:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136cb63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237246080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756100.917816:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1784756100.917852:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136cb63b80 x1871452237246080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756116 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756100.917871:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136cb63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237246080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784756100.919159:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136cb60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3291:1871452237246336:0@lo:400:kworker.0 00000100:00100000:3.0:1784756100.919206:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756100.919239:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1784756100.919245:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136cb63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3a5739ad-a70a-4582-8756-59cdd498af45:3291:1871452237246208:0@lo:400:kworker.0 00000100:00100000:3.0:1784756100.919278:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756100.919306:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136cb60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3291:1871452237246720:0@lo:400:kworker.0 00000100:00100000:3.0:1784756100.919327:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756100.919356:0:8296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237246336 00000100:00100000:3.0:1784756100.919361:0:8296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237246336 00000100:00100000:3.0:1784756100.919390:0:8296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237246720 00000100:00100000:3.0:1784756100.919392:0:8296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237246720 00000100:00100000:3.0:1784756100.919407:0:8296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1784756100.919428:0:8296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136cb63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1871452237246336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756100.919475:0:8296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136cb63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1871452237246336:12345-0@lo:400:kworker.0 Request processed in 63us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756100.919480:0:8296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1784756100.919490:0:8296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784756100.920300:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136cb62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1871452237246592:0@lo:400:kworker.0 00000100:00100000:0.0:1784756100.920339:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756100.920364:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784756100.920370:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136cb61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3293:1871452237246464:0@lo:400:kworker.0 00000100:00100000:0.0:1784756100.920392:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784756100.920435:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784756100.920441:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784756100.920528:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237246592 00000100:00100000:0.0:1784756100.920533:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237246592 00000100:00100000:0.0:1784756100.920571:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784756100.920590:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136fa4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1871452237246592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756100.921244:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136fa4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1871452237246592:12345-0@lo:400:kworker.0 Request processed in 666us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756100.921253:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784756100.921277:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237246464 00000100:00100000:0.0:1784756100.921286:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237246464 00000100:00100000:0.0:1784756100.921307:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1784756100.921312:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136fa4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1871452237246464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756100.921341:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136fa4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1871452237246464:12345-0@lo:400:kworker.0 Request processed in 29us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756100.921347:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1784756100.921364:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784756100.921366:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784756100.922123:0:8296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136cb61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1871452237246720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756100.922181:0:8296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136cb61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1871452237246720:12345-0@lo:400:kworker.0 Request processed in 2685us (2852us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756100.922189:0:8296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784756100.922216:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237246208 00000100:00100000:3.0:1784756100.922221:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237246208 00000100:00100000:3.0:1784756100.922251:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1784756100.922256:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+19:3291:x1871452237246208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756100.922287:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+19:3291:x1871452237246208:12345-0@lo:400:kworker.0 Request processed in 31us (3008us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756100.922293:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1784756100.922347:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136cb63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3a5739ad-a70a-4582-8756-59cdd498af45:3291:1871452237246208:0@lo:400:kworker.0 00000100:00100000:3.0:1784756100.922360:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136cb60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3291:1871452237246720:0@lo:400:kworker.0 00000100:00100000:3.0:1784756100.922371:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136cb60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3291:1871452237246336:0@lo:400:kworker.0 00000100:00100000:1.0:1784756100.923175:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136cb61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3293:1871452237246464:0@lo:400:kworker.0 00010000:00080000:1.0:1784756100.923192:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136cb62a00 x1871452237246592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756100.923203:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136cb62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1871452237246592:0@lo:400:kworker.0 00000001:02000400:1.0:1784756101.199746:0:10487:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1784756101.492687:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756101.661984:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1784756101.662218:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1784756101.662561:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228822656 00000100:00100000:0.0:1784756101.662571:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228822656 00000100:00100000:0.0:1784756101.662653:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 71 00000100:00100000:0.0:1784756101.662664:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891353e84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2351:x1871452228822656:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1784756101.662753:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891353e84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2351:x1871452228822656:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 92us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756101.662761:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 71 00000100:00080000:1.0:1784756101.663106:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784756101.665547:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228822528 00000100:00100000:3.0:1784756101.665560:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228822528 00000100:00100000:3.0:1784756101.665697:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 210 00000100:00100000:3.0:1784756101.665708:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e891795-8b87-4754-b411-3420f9834f05+10:2351:x1871452228822528:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1784756101.665791:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e891795-8b87-4754-b411-3420f9834f05+10:2351:x1871452228822528:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 84us (3818us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756101.665815:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 210 00010000:00010000:0.0:1784756102.527147:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756103.481681:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136fa48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3291:1871452237246848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784756103.481762:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756103.481850:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237246848 00000100:00100000:0.0:1784756103.481857:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237246848 00000100:00100000:0.0:1784756103.481910:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784756103.481919:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136fa49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1871452237246848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784756103.481952:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784756103.481997:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136fa49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1871452237246848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756103.482004:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1784756103.482025:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784756103.482064:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136fa48700 x1871452237246848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756119 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756103.482082:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136fa48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3291:1871452237246848:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784756103.539534:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756104.563653:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756105.588094:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756106.036077:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136fa48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3291:1871452237247360:0@lo:400:kworker.0 00000100:00100000:0.0:1784756106.036161:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756106.036231:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1784756106.036237:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136fa4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3291:1871452237247232:0@lo:400:kworker.0 00000100:00100000:0.0:1784756106.036261:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756106.036275:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136fa4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3291:1871452237247744:0@lo:400:kworker.0 00000100:00100000:0.0:1784756106.036298:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756106.036329:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237247744 00000100:00100000:0.0:1784756106.036348:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237247744 00000100:00100000:0.0:1784756106.036431:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784756106.036441:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136fa4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1871452237247744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756106.036720:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136fa4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1871452237247744:12345-0@lo:400:kworker.0 Request processed in 280us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756106.036729:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1784756106.036753:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1784756106.036783:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136fa4ad80 x1871452237247744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756106.036798:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136fa4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3291:1871452237247744:0@lo:400:kworker.0 00000100:00100000:3.0:1784756106.037336:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237247360 00000100:00100000:3.0:1784756106.037342:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237247360 00000100:00100000:3.0:1784756106.037385:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237247232 00000100:00100000:3.0:1784756106.037388:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237247232 00000100:00100000:3.0:1784756106.037442:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784756106.037461:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136fa49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1871452237247360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756106.037681:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136fa49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1871452237247360:12345-0@lo:400:kworker.0 Request processed in 231us (1520us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756106.037688:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784756106.037703:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1784756106.037709:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136fa48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1871452237247232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756106.037735:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136fa48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1871452237247232:12345-0@lo:400:kworker.0 Request processed in 27us (1474us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756106.037741:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1784756106.037779:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136fa4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3291:1871452237247232:0@lo:400:kworker.0 00000100:00100000:3.0:1784756106.037790:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136fa48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3291:1871452237247360:0@lo:400:kworker.0 00000100:00100000:1.0:1784756106.038945:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136cb60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237246976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784756106.039006:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756106.039062:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136fa4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237247488:0@lo:400:kworker.0 00000100:00100000:1.0:1784756106.039126:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756106.039154:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784756106.039161:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136fa48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a5739ad-a70a-4582-8756-59cdd498af45:3292:1871452237247104:0@lo:400:kworker.0 00000100:00100000:1.0:1784756106.039189:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756106.039213:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136fa49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3292:1871452237247616:0@lo:400:kworker.0 00000100:00100000:1.0:1784756106.039236:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756106.039273:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237247488 00000100:00100000:1.0:1784756106.039279:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237247488 00000100:00100000:1.0:1784756106.039324:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784756106.039332:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136ce53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237247488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756106.039380:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136ce53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237247488:12345-0@lo:400:kworker.0 Request processed in 49us (253us total) trans 0 rc 0/0 00000100:00080000:0.0:1784756106.039553:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784756106.039560:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784756106.039690:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784756106.039717:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237247104 00000100:00100000:1.0:1784756106.039721:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237247104 00000100:00100000:1.0:1784756106.039746:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1784756106.039752:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+19:3292:x1871452237247104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756106.039787:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+19:3292:x1871452237247104:12345-0@lo:400:kworker.0 Request processed in 35us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756106.039794:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1784756106.039820:0:8296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237247616 00000100:00100000:1.0:1784756106.039823:0:8296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237247616 00000100:00100000:1.0:1784756106.039855:0:8296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784756106.039861:0:8296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136ce53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1871452237247616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756106.039890:0:8296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136ce53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1871452237247616:12345-0@lo:400:kworker.0 Request processed in 28us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756106.039896:0:8296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1784756106.039912:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784756106.039938:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136fa48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a5739ad-a70a-4582-8756-59cdd498af45:3292:1871452237247104:0@lo:400:kworker.0 00000100:00100000:1.0:1784756106.039951:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136fa49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3292:1871452237247616:0@lo:400:kworker.0 00010000:00080000:1.0:1784756106.039965:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136fa4b480 x1871452237247488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756106.039975:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136fa4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237247488:0@lo:400:kworker.0 00000100:00100000:2.0:1784756106.040246:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237246976 00000100:00100000:2.0:1784756106.040251:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237246976 00000100:00100000:2.0:1784756106.040290:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784756106.040298:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913585cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237246976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784756106.040326:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756106.040365:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913585cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237246976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (1359us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756106.040372:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1784756106.041461:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136cb60700 x1871452237246976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756122 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756106.041491:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136cb60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237246976:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784756106.612993:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756106.777371:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1784756106.777572:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1784756106.777663:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228822912 00000100:00100000:3.0:1784756106.777672:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228822912 00000100:00100000:3.0:1784756106.777760:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 75 00000100:00100000:3.0:1784756106.777773:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891353e86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2352:x1871452228822912:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1784756106.777853:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891353e86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2352:x1871452228822912:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 83us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756106.777880:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 75 00000100:00080000:0.0:1784756106.777951:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784756106.779258:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228822784 00000100:00100000:1.0:1784756106.779267:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228822784 00000100:00100000:3.0:1784756106.779478:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 212 00000100:00100000:3.0:1784756106.779489:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e891795-8b87-4754-b411-3420f9834f05+10:2351:x1871452228822784:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1784756106.779555:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e891795-8b87-4754-b411-3420f9834f05+10:2351:x1871452228822784:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 68us (2194us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756106.779562:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 212 00010000:00010000:2.0:1784756107.637098:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756108.598231:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784756108.598254:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237247872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784756108.598390:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756108.600054:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237247872 00000100:00100000:2.0:1784756108.600064:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237247872 00000100:00100000:2.0:1784756108.600142:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784756108.600151:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136ce50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1871452237247872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784756108.600202:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756108.600280:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136ce50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1871452237247872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (1890us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756108.600288:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1784756108.600484:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891353e87b80 x1871452237247872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756124 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756108.600509:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237247872:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784756108.600740:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784756108.671123:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756109.690113:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756110.708021:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756111.155767:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784756111.155793:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136cb60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1871452237248000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784756111.155872:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756111.155937:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237248000 00000100:00100000:3.0:1784756111.155944:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237248000 00000100:00100000:3.0:1784756111.155998:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784756111.156007:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136cb63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1871452237248000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784756111.156039:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784756111.156096:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136cb63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1871452237248000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756111.156103:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1784756111.156124:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1784756111.156151:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136cb60380 x1871452237248000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756127 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756111.156183:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136cb60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1871452237248000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784756111.162742:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136ce52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3290:1871452237248256:0@lo:400:kworker.0 00000100:00100000:1.0:1784756111.162807:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756111.162842:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784756111.162922:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136ce51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3a5739ad-a70a-4582-8756-59cdd498af45:3293:1871452237248128:0@lo:400:kworker.0 00000100:00100000:2.0:1784756111.162954:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756111.162981:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136ce51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3293:1871452237248640:0@lo:400:kworker.0 00000100:00100000:2.0:1784756111.163002:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756111.163017:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784756111.163022:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136ce53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1871452237248512:0@lo:400:kworker.0 00000100:00100000:2.0:1784756111.163044:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756111.164364:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237248512 00000100:00100000:3.0:1784756111.164375:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237248512 00000100:00100000:3.0:1784756111.164468:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784756111.164479:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891353e85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1871452237248512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756111.164544:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891353e85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1871452237248512:12345-0@lo:400:kworker.0 Request processed in 68us (1499us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756111.164551:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784756111.164666:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136ce50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3290:1871452237248384:0@lo:400:kworker.0 00000100:00100000:1.0:1784756111.164699:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756111.164742:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237248256 00000100:00100000:1.0:1784756111.164746:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237248256 00000100:00100000:1.0:1784756111.164771:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237248640 00000100:00100000:1.0:1784756111.164774:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237248640 00000100:00100000:1.0:1784756111.164791:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237248384 00000100:00100000:1.0:1784756111.164793:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237248384 00000100:00100000:1.0:1784756111.164807:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1784756111.164813:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136ce52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1871452237248256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756111.164932:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1784756111.164940:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891353e87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1871452237248640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756111.164971:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891353e87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1871452237248640:12345-0@lo:400:kworker.0 Request processed in 32us (1968us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756111.164978:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1784756111.164992:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1784756111.164998:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136ce51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1871452237248384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756111.165020:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136ce51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1871452237248384:12345-0@lo:400:kworker.0 Request processed in 23us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756111.165026:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1784756111.165066:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136ce52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1871452237248256:12345-0@lo:400:kworker.0 Request processed in 34us (2039us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756111.165074:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1784756111.165093:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237248128 00000100:00100000:1.0:1784756111.165097:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237248128 00000100:00100000:1.0:1784756111.165130:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1784756111.165136:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+19:3293:x1871452237248128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756111.165165:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+19:3293:x1871452237248128:12345-0@lo:400:kworker.0 Request processed in 30us (2211us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756111.165184:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00080000:0.0:1784756111.165478:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784756111.165488:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784756111.165572:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136ce50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3290:1871452237248384:0@lo:400:kworker.0 00000100:00100000:1.0:1784756111.165585:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136ce52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3290:1871452237248256:0@lo:400:kworker.0 00010000:00080000:2.0:1784756111.165690:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136ce53480 x1871452237248512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756111.165702:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136ce53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1871452237248512:0@lo:400:kworker.0 00000100:00100000:2.0:1784756111.165712:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136ce51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3a5739ad-a70a-4582-8756-59cdd498af45:3293:1871452237248128:0@lo:400:kworker.0 00000100:00100000:2.0:1784756111.165721:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136ce51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3293:1871452237248640:0@lo:400:kworker.0 00010000:00010000:2.0:1784756111.733823:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756111.907866:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1784756111.907910:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1784756111.907978:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228823168 00000100:00100000:0.0:1784756111.907987:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228823168 00000100:00100000:0.0:1784756111.908076:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 79 00000100:00100000:0.0:1784756111.908087:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891353e87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2351:x1871452228823168:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1784756111.908158:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891353e87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2351:x1871452228823168:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 72us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756111.908166:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 79 00000100:00080000:2.0:1784756111.908315:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784756111.910286:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228823040 00000100:00100000:3.0:1784756111.910296:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228823040 00000100:00100000:3.0:1784756111.910407:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 214 00000100:00100000:3.0:1784756111.910432:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e891795-8b87-4754-b411-3420f9834f05+10:2351:x1871452228823040:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1784756111.910503:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e891795-8b87-4754-b411-3420f9834f05+10:2351:x1871452228823040:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 88us (2647us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756111.910522:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 214 00010000:00010000:2.0:1784756112.755568:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756113.715642:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237248768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784756113.715711:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756113.715748:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237248768 00000100:00100000:3.0:1784756113.715757:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237248768 00000100:00100000:3.0:1784756113.715819:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784756113.715829:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136ce52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1871452237248768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784756113.715862:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784756113.715907:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136ce52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1871452237248768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756113.715914:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1784756113.715966:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784756113.719119:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891353e84e00 x1871452237248768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756129 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756113.719146:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237248768:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784756113.780275:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756114.803639:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756115.828273:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756116.275747:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136ce50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3a5739ad-a70a-4582-8756-59cdd498af45:3291:1871452237248896:0@lo:400:kworker.0 00000100:00100000:1.0:1784756116.275820:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756116.275867:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136cb60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3291:1871452237249024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784756116.275892:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756116.275911:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136ce52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3291:1871452237249536:0@lo:400:kworker.0 00000100:00100000:1.0:1784756116.275930:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756116.275953:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784756116.275958:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136ce50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3291:1871452237249408:0@lo:400:kworker.0 00000100:00100000:1.0:1784756116.275980:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756116.276020:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136ce50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3292:1871452237249152:0@lo:400:kworker.0 00000100:00100000:1.0:1784756116.276043:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756116.276059:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136ce51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237249664:0@lo:400:kworker.0 00000100:00100000:1.0:1784756116.276077:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756116.276091:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784756116.276112:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136ce53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3292:1871452237249280:0@lo:400:kworker.0 00000100:00100000:1.0:1784756116.276134:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756116.276164:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237248896 00000100:00100000:3.0:1784756116.276165:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237249536 00000100:00100000:3.0:1784756116.276172:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237249536 00000100:00100000:1.0:1784756116.276172:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237248896 00000100:00100000:1.0:1784756116.276216:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1784756116.276219:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237249152 00000100:00100000:3.0:1784756116.276221:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237249152 00000100:00100000:1.0:1784756116.276225:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+19:3291:x1871452237248896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756116.276237:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237249280 00000100:00100000:3.0:1784756116.276240:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237249280 00000100:00100000:3.0:1784756116.276253:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1784756116.276258:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136ce51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1871452237249536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756116.276276:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+19:3291:x1871452237248896:12345-0@lo:400:kworker.0 Request processed in 52us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756116.276285:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1784756116.276292:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136ce51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1871452237249536:12345-0@lo:400:kworker.0 Request processed in 35us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756116.276297:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1784756116.276310:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1784756116.276315:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136ce51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1871452237249152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756116.276316:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237249024 00000100:00100000:1.0:1784756116.276319:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237249024 00000100:00100000:3.0:1784756116.276344:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136ce51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1871452237249152:12345-0@lo:400:kworker.0 Request processed in 28us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756116.276344:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784756116.276350:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1784756116.276350:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136ce50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1871452237249024:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784756116.276360:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1784756116.276364:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136ce53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1871452237249280:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1784756116.276378:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784756116.276393:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136ce53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1871452237249280:12345-0@lo:400:kworker.0 Request processed in 28us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756116.276400:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1784756116.276403:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136ce50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1871452237249024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756116.276409:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784756116.276455:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237249408 00000100:00100000:1.0:1784756116.276458:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237249408 00000100:00100000:1.0:1784756116.276568:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237249664 00000100:00100000:1.0:1784756116.276571:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237249664 00000100:00100000:1.0:1784756116.276591:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784756116.276600:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136ce52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1871452237249408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756116.276632:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136ce52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1871452237249408:12345-0@lo:400:kworker.0 Request processed in 35us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756116.276638:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784756116.276648:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784756116.276653:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136ce51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237249664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756116.276684:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136ce51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237249664:12345-0@lo:400:kworker.0 Request processed in 31us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756116.276690:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784756116.276740:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136ce53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3292:1871452237249280:0@lo:400:kworker.0 00000100:00100000:1.0:1784756116.276752:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136ce50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3292:1871452237249152:0@lo:400:kworker.0 00010000:00080000:1.0:1784756116.276764:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136ce51c00 x1871452237249664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756116.276773:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136ce51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237249664:0@lo:400:kworker.0 00010000:00080000:1.0:1784756116.276804:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136ce50000 x1871452237249408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756116.276812:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136ce50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3291:1871452237249408:0@lo:400:kworker.0 00000100:00100000:1.0:1784756116.276820:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136ce50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3a5739ad-a70a-4582-8756-59cdd498af45:3291:1871452237248896:0@lo:400:kworker.0 00010000:00080000:1.0:1784756116.276827:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136cb60380 x1871452237249024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756132 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756116.276838:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136cb60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3291:1871452237249024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784756116.276846:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136ce52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3291:1871452237249536:0@lo:400:kworker.0 00000100:00080000:2.0:1784756116.279085:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784756116.279148:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784756116.279153:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784756116.857979:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756117.017687:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1784756117.017752:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1784756117.017836:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228823424 00000100:00100000:3.0:1784756117.017846:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228823424 00000100:00100000:3.0:1784756117.017916:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 83 00000100:00100000:3.0:1784756117.017927:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891353e84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2352:x1871452228823424:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1784756117.018019:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891353e84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2352:x1871452228823424:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 93us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756117.018026:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 83 00000100:00100000:0.0:1784756117.018604:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228823296 00000100:00100000:0.0:1784756117.018610:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228823296 00000100:00100000:0.0:1784756117.018650:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 216 00000100:00100000:0.0:1784756117.018657:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+10:2352:x1871452228823296:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1784756117.018696:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+10:2352:x1871452228823296:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 39us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756117.018703:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 216 00000100:00080000:2.0:1784756117.019056:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784756117.875574:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756118.836543:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1871452237249792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784756118.836627:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756118.836806:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237249792 00000100:00100000:2.0:1784756118.836815:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237249792 00000100:00100000:2.0:1784756118.836879:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784756118.836889:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136cb62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1871452237249792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784756118.836934:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756118.836994:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136cb62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1871452237249792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756118.837000:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1784756118.837040:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891353e86a00 x1871452237249792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756134 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756118.837058:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1871452237249792:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1784756118.837639:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784756118.899774:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756119.924646:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784756119.997703:0:11186:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1784756120.947647:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756121.400673:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136ce52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a5739ad-a70a-4582-8756-59cdd498af45:3290:1871452237249920:0@lo:400:kworker.0 00000100:00100000:1.0:1784756121.400747:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756121.400795:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136ce50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3290:1871452237250432:0@lo:400:kworker.0 00000100:00100000:1.0:1784756121.400850:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756121.400884:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784756121.400891:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136ce50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3290:1871452237250048:0@lo:400:kworker.0 00000100:00100000:1.0:1784756121.400915:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756121.400932:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136ce53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237250560:0@lo:400:kworker.0 00000100:00100000:1.0:1784756121.400966:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756121.400995:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136ce51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1871452237250304:0@lo:400:kworker.0 00000100:00100000:1.0:1784756121.401019:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756121.401036:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784756121.401041:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136ce50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3293:1871452237250176:0@lo:400:kworker.0 00000100:00100000:1.0:1784756121.401060:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756121.401090:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237249920 00000100:00100000:1.0:1784756121.401099:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237249920 00000100:00100000:1.0:1784756121.401149:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1784756121.401158:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+19:3290:x1871452237249920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756121.401209:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+19:3290:x1871452237249920:12345-0@lo:400:kworker.0 Request processed in 52us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756121.401216:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1784756121.401246:0:8296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237250432 00000100:00100000:1.0:1784756121.401249:0:8296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237250432 00000100:00100000:0.0:1784756121.401617:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237250688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784756121.401649:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756121.402474:0:8296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237250048 00000100:00100000:1.0:1784756121.402480:0:8296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237250048 00000100:00100000:1.0:1784756121.402499:0:8296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237250176 00000100:00100000:1.0:1784756121.402503:0:8296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237250176 00000100:00100000:1.0:1784756121.402523:0:8296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1784756121.402531:0:8296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f83ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1871452237250432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756121.402586:0:8296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f83ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1871452237250432:12345-0@lo:400:kworker.0 Request processed in 55us (1735us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756121.402592:0:8296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1784756121.402617:0:8296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1784756121.402623:0:8296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1871452237250048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756121.402654:0:8296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1871452237250048:12345-0@lo:400:kworker.0 Request processed in 31us (1738us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756121.402660:0:8296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1784756121.402672:0:8296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1784756121.402677:0:8296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1871452237250176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756121.402705:0:8296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1871452237250176:12345-0@lo:400:kworker.0 Request processed in 28us (1644us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756121.402711:0:8296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1784756121.402734:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237250560 00000100:00100000:1.0:1784756121.402737:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237250560 00000100:00100000:1.0:1784756121.402762:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237250304 00000100:00100000:1.0:1784756121.402765:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237250304 00000100:00100000:1.0:1784756121.402788:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784756121.402794:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f838e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3290:x1871452237250560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756121.402921:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237250688 00000100:00100000:2.0:1784756121.402925:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237250688 00000100:00100000:2.0:1784756121.402950:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784756121.402967:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136fa4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3292:x1871452237250688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784756121.402998:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756121.403045:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136fa4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3292:x1871452237250688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (1394us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756121.403057:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1784756121.403473:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784756121.403479:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784756121.403482:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784756121.403932:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f838e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3290:x1871452237250560:12345-0@lo:400:kworker.0 Request processed in 1134us (2961us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756121.403942:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784756121.403976:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784756121.403986:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f83b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1871452237250304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756121.404028:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f83b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1871452237250304:12345-0@lo:400:kworker.0 Request processed in 45us (3008us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756121.404034:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784756121.404533:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136ce50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3293:1871452237250176:0@lo:400:kworker.0 00010000:00080000:1.0:1784756121.404548:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136ce51c00 x1871452237250304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756121.404571:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136ce51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1871452237250304:0@lo:400:kworker.0 00000100:00100000:1.0:1784756121.404610:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136ce50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3290:1871452237250048:0@lo:400:kworker.0 00010000:00080000:1.0:1784756121.404621:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136ce53100 x1871452237250560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756121.404630:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136ce53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237250560:0@lo:400:kworker.0 00000100:00100000:1.0:1784756121.404640:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136ce52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a5739ad-a70a-4582-8756-59cdd498af45:3290:1871452237249920:0@lo:400:kworker.0 00000100:00100000:1.0:1784756121.404650:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136ce50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3290:1871452237250432:0@lo:400:kworker.0 00010000:00080000:0.0:1784756121.406342:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff891353e86a00 x1871452237250688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756137 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756121.406369:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237250688:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784756121.971985:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756122.142231:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1784756122.142360:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1784756122.142452:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228823552 00000100:00100000:2.0:1784756122.142476:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228823552 00000100:00100000:2.0:1784756122.142530:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 218 00000100:00100000:2.0:1784756122.142540:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+10:2353:x1871452228823552:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1784756122.142612:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+10:2353:x1871452228823552:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 73us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756122.142620:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 218 00000100:00100000:1.0:1784756122.142868:0:8296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228823680 00000100:00100000:1.0:1784756122.142873:0:8296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228823680 00000100:00100000:1.0:1784756122.143074:0:8296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 87 00000100:00100000:1.0:1784756122.143093:0:8296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891353e86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2353:x1871452228823680:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1784756122.143160:0:8296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891353e86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2353:x1871452228823680:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 79us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756122.143168:0:8296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 87 00000100:00080000:2.0:1784756122.143435:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784756122.996356:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756123.960452:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136cb61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1871452237250816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784756123.960519:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756123.960587:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237250816 00000100:00100000:3.0:1784756123.960594:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237250816 00000100:00100000:3.0:1784756123.960640:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784756123.960648:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136cb60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1871452237250816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784756123.960677:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784756123.960713:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136cb60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1871452237250816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756123.960720:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1784756123.960738:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784756123.960760:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136cb61f80 x1871452237250816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756139 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756123.960787:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136cb61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1871452237250816:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784756124.020812:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784756124.034659:0:11333:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd795c1e00 20000000:00000080:1.0:1784756124.034689:0:11333:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff89136ce54400 uarg=0000000000000000 20000000:01000000:1.0:1784756124.034736:0:11333:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1784756124.034743:0:11333:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1784756124.034751:0:11333:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1784756124.039700:0:11334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1784756124.039897:0:11333:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1784756124.061111:0:11333:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1784756124.061194:0:11333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff891350391a00/0xc0f560bd53f90e8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756124.061219:0:11333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89134151bc00/0xc0f560bd53f90be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f90b7 expref: 18 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756124.061227:0:11333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891350390600/0xc0f560bd53f90cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f90c5 expref: 18 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756124.061244:0:11333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff891350390400/0xc0f560bd53f90da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f90d3 expref: 18 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756124.061254:0:11333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89134151be00/0xc0f560bd53f90e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac42 expref: 9 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756124.061283:0:11333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff891350391a00/0xc0f560bd53f90e8 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756124.061334:0:11333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89134151be00/0xc0f560bd53f90e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac42 expref: 9 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756124.061352:0:11333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89134151be00/0xc0f560bd53f90e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac42 expref: 9 pid: 5767 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756124.061368:0:11333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e84e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11333:1871452237250944:192.168.202.41@tcp:104: 00010000:00010000:2.0:1784756124.061654:0:11333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891350390400/0xc0f560bd53f90da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0f560bd53f90d3 expref: 18 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756124.061667:0:11333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff891350390400/0xc0f560bd53f90da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0f560bd53f90d3 expref: 18 pid: 5769 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756124.061678:0:11333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136bd89c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11333:1871452237251072:0@lo:104: 00000100:00100000:2.0:1784756124.061724:0:11333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756124.062009:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237251072 00000100:00100000:1.0:1784756124.062021:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237251072 00000100:00100000:1.0:1784756124.062076:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784756124.062097:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136bd88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3a5739ad-a70a-4582-8756-59cdd498af45+3:11333:x1871452237251072:12345-0@lo:104: 00010000:00010000:1.0:1784756124.062115:0:5757:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff89135fc58c00/0xc0f560bd53f90d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f90da expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756124.068759:0:11333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff891350390600/0xc0f560bd53f90cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0f560bd53f90c5 expref: 18 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756124.068777:0:11333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff891350390600/0xc0f560bd53f90cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0f560bd53f90c5 expref: 18 pid: 5769 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756124.068792:0:11333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136bd89180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11333:1871452237251200:0@lo:104: 00000100:00100000:2.0:1784756124.068853:0:11333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784756124.068885:0:11333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89134151bc00/0xc0f560bd53f90be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc0f560bd53f90b7 expref: 18 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756124.068912:0:11333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89134151bc00/0xc0f560bd53f90be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc0f560bd53f90b7 expref: 18 pid: 5769 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756124.068921:0:11333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136bd8bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11333:1871452237251328:0@lo:104: 00000100:00100000:2.0:1784756124.068955:0:11333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756124.068966:0:11333:0:(client.c:2702:ptlrpc_set_wait()) set ffff89136bcafd80 going to sleep for 11 seconds 00010000:00010000:0.0:1784756124.069204:0:5757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784756124.069213:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136bd88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3a5739ad-a70a-4582-8756-59cdd498af45+3:11333:x1871452237251072:12345-0@lo:104: Request processed in 7116us (7487us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756124.069223:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784756124.069267:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237251200 00000100:00100000:0.0:1784756124.069273:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237251200 00000100:00100000:0.0:1784756124.069301:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237251328 00000100:00100000:0.0:1784756124.069304:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237251328 00000100:00100000:0.0:1784756124.069317:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784756124.069324:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136bd8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3a5739ad-a70a-4582-8756-59cdd498af45+4:11333:x1871452237251200:12345-0@lo:104: 00010000:00010000:0.0:1784756124.069336:0:5757:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff891350391200/0xc0f560bd53f90c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f90cc expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756124.069379:0:5757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784756124.069384:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136bd8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3a5739ad-a70a-4582-8756-59cdd498af45+4:11333:x1871452237251200:12345-0@lo:104: Request processed in 61us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756124.069390:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784756124.069406:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784756124.069411:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136bd8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3a5739ad-a70a-4582-8756-59cdd498af45+3:11333:x1871452237251328:12345-0@lo:104: 00000100:00100000:3.0:1784756124.069470:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1784756124.069504:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228823808 00000100:00100000:3.0:1784756124.069510:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228823808 00010000:00010000:3.0:1784756124.069532:0:5761:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89134151be00/0xc0f560bd53f90e1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac42 expref: 10 pid: 5767 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756124.069554:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 25 00000100:00100000:3.0:1784756124.069561:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913469c4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e891795-8b87-4754-b411-3420f9834f05+10:2351:x1871452228823808:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784756124.069571:0:5761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784756124.069577:0:5761:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89134151be00/0xc0f560bd53f90e1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac42 expref: 10 pid: 5767 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756124.069587:0:5761:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89134151be00/0xc0f560bd53f90e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac42 expref: 10 pid: 5767 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756124.069607:0:5761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784756124.069641:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913469c4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e891795-8b87-4754-b411-3420f9834f05+10:2351:x1871452228823808:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 81us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756124.069648:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 25 00010000:00010000:0.0:1784756124.069742:0:5757:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff891350391c00/0xc0f560bd53f90b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f90be expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756124.069776:0:5757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1784756124.069782:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136bd8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3a5739ad-a70a-4582-8756-59cdd498af45+3:11333:x1871452237251328:12345-0@lo:104: Request processed in 371us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756124.069788:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1784756124.069804:0:5763:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784756124.069810:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff89135fc58c00/0xc0f560bd53f90d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f90da expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756124.069818:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89135fc58c00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:0.0:1784756124.069822:0:5763:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff89135fc58c00/0xc0f560bd53f90d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0f560bd53f90da expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756124.069842:0:5763:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff89135fc58c00/0xc0f560bd53f90d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0f560bd53f90da expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784756124.069850:0:5763:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff89135fc58c00/0xc0f560bd53f90d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0f560bd53f90da expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784756124.069856:0:5763:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784756124.069886:0:5763:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff89135fc58c00/0xc0f560bd53f90d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f90da expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756124.069892:0:5763:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784756124.069909:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff89135fc58c00/0xc0f560bd53f90d3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f90da expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756124.069917:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff89135fc58c00/0xc0f560bd53f90d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f90da expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756124.070491:0:7465:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784756124.070499:0:7465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff891350391c00/0xc0f560bd53f90b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f90be expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756124.070506:0:7465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891350391c00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:1.0:1784756124.070509:0:7465:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff891350391c00/0xc0f560bd53f90b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0f560bd53f90be expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756124.070516:0:7465:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff891350391c00/0xc0f560bd53f90b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0f560bd53f90be expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784756124.070522:0:7465:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff891350391c00/0xc0f560bd53f90b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0f560bd53f90be expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784756124.070527:0:7465:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784756124.070547:0:7465:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff891350391c00/0xc0f560bd53f90b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f90be expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756124.070553:0:7465:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784756124.070560:0:7465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff891350391c00/0xc0f560bd53f90b7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f90be expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756124.070566:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff891350391c00/0xc0f560bd53f90b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f90be expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756124.070574:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756124.070576:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756124.070584:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756124.070592:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756124.070614:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136fa48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a5739ad-a70a-4582-8756-59cdd498af45:3290:1871452237251456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784756124.070656:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756124.070698:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784756124.070703:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136f83a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a5739ad-a70a-4582-8756-59cdd498af45:3290:1871452237251584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784756124.070722:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784756124.071003:0:5763:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784756124.071009:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff891350391200/0xc0f560bd53f90c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc0f560bd53f90cc expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756124.071017:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891350391200 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:0.0:1784756124.071020:0:5763:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff891350391200/0xc0f560bd53f90c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc0f560bd53f90cc expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756124.071027:0:5763:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff891350391200/0xc0f560bd53f90c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc0f560bd53f90cc expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784756124.071033:0:5763:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff891350391200/0xc0f560bd53f90c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc0f560bd53f90cc expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784756124.071045:0:5763:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784756124.071074:0:5763:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff891350391200/0xc0f560bd53f90c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f90cc expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756124.071081:0:5763:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784756124.071097:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff891350391200/0xc0f560bd53f90c5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f90cc expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756124.071104:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff891350391200/0xc0f560bd53f90c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc0f560bd53f90cc expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756124.071117:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756124.071118:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756124.071120:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756124.071133:0:5759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237251456 00000100:00100000:0.0:1784756124.071138:0:5759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237251456 00010000:00010000:0.0:1784756124.071162:0:5759:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891350390400/0xc0f560bd53f90da lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f90d3 expref: 19 pid: 5769 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756124.071184:0:5759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237251584 00000100:00100000:0.0:1784756124.071188:0:5759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237251584 00010000:00010000:0.0:1784756124.071198:0:5759:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89134151bc00/0xc0f560bd53f90be lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f90b7 expref: 20 pid: 5769 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756124.071214:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784756124.071220:0:5759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f839c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a5739ad-a70a-4582-8756-59cdd498af45+20:3290:x1871452237251456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784756124.071230:0:5759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784756124.071699:0:11333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89134151be00/0xc0f560bd53f90e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac42 expref: 9 pid: 5767 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756124.071712:0:11333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e84e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11333:1871452237250944:192.168.202.41@tcp:104: 00000100:00100000:2.0:1784756124.071723:0:11333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136bd89c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11333:1871452237251072:0@lo:104: 00000100:00100000:2.0:1784756124.071732:0:11333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136bd89180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11333:1871452237251200:0@lo:104: 00000100:00100000:2.0:1784756124.071739:0:11333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136bd8bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11333:1871452237251328:0@lo:104: 00010000:00010000:2.0:1784756124.071768:0:11333:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff891350391a00/0xc0f560bd53f90e8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756124.071876:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136fa4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a5739ad-a70a-4582-8756-59cdd498af45:3292:1871452237251712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784756124.071917:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756124.071977:0:7464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237251712 00000100:00100000:2.0:1784756124.071981:0:7464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237251712 00010000:00010000:2.0:1784756124.072000:0:7464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff891350390600/0xc0f560bd53f90cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f90c5 expref: 21 pid: 5769 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756124.072018:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784756124.072025:0:7464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f838a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a5739ad-a70a-4582-8756-59cdd498af45+21:3290:x1871452237251584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784756124.072035:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784756124.072049:0:7464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89134151bc00/0xc0f560bd53f90be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f90b7 expref: 21 pid: 5769 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756124.072058:0:7464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89134151bc00/0xc0f560bd53f90be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0f560bd53f90b7 expref: 21 pid: 5769 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756124.072072:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89134151bc00/0xc0f560bd53f90be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0f560bd53f90b7 expref: 21 pid: 5769 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756124.072084:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784756124.072114:0:7464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f838a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a5739ad-a70a-4582-8756-59cdd498af45+20:3290:x1871452237251584:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (1391us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756124.072121:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784756124.072137:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784756124.072145:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136bd8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a5739ad-a70a-4582-8756-59cdd498af45+19:3292:x1871452237251712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784756124.072153:0:5761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784756124.072157:0:5761:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891350390600/0xc0f560bd53f90cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f90c5 expref: 19 pid: 5769 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756124.072173:0:5761:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891350390600/0xc0f560bd53f90cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0f560bd53f90c5 expref: 19 pid: 5769 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756124.072184:0:5761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891350390600/0xc0f560bd53f90cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0f560bd53f90c5 expref: 19 pid: 5769 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756124.072193:0:5761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784756124.072216:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136f83a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a5739ad-a70a-4582-8756-59cdd498af45:3290:1871452237251584:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784756124.072220:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136bd8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a5739ad-a70a-4582-8756-59cdd498af45+18:3292:x1871452237251712:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (303us total) trans 0 rc 0/0 00010000:00010000:0.0:1784756124.072259:0:5759:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff891350390400/0xc0f560bd53f90da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc0f560bd53f90d3 expref: 18 pid: 5769 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756124.072279:0:5759:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff891350390400/0xc0f560bd53f90da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc0f560bd53f90d3 expref: 18 pid: 5769 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756124.072289:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891350390400/0xc0f560bd53f90da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc0f560bd53f90d3 expref: 18 pid: 5769 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756124.072301:0:5759:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff891350391a00/0xc0f560bd53f90e8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756124.072309:0:5759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891350391a00/0xc0f560bd53f90e8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756124.072322:0:5759:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff891350391a00/0xc0f560bd53f90e8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756124.072329:0:5759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff891350391a00/0xc0f560bd53f90e8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756124.072336:0:5759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff891350391a00/0xc0f560bd53f90e8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756124.072342:0:5759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff891350391a00/0xc0f560bd53f90e8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756124.072348:0:5759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891350391a00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:0.0:1784756124.072352:0:5759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff891350391a00/0xc0f560bd53f90e8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756124.072359:0:5759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff891350391a00/0xc0f560bd53f90e8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756124.072382:0:5759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff891350391a00/0xc0f560bd53f90e8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756124.072392:0:5759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784756124.072449:0:5759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f839c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a5739ad-a70a-4582-8756-59cdd498af45+17:3290:x1871452237251456:12345-0@lo:103:ldlm_bl.0 Request processed in 1229us (1791us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756124.072564:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136fa48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a5739ad-a70a-4582-8756-59cdd498af45:3290:1871452237251456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784756124.078810:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136fa4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a5739ad-a70a-4582-8756-59cdd498af45:3292:1871452237251712:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784756124.079499:0:11333:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff891350391a00/0xc0f560bd53f90e8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756124.079519:0:11333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff891350391a00/0xc0f560bd53f90e8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756124.079529:0:11333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff891350391a00/0xc0f560bd53f90e8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756124.079963:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784756124.093741:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1784756125.043743:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784756125.316434:0:5772:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784756125.316446:0:5772:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89136f870000 from 7 10000000:01000000:3.0:1784756125.316451:0:5772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784756125.316515:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff89134151b400/0xc0f560bd53f90ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756125.316528:0:5772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff89134151b400/0xc0f560bd53f90ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756125.316539:0:5772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff89134151b400/0xc0f560bd53f90ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756125.316567:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136cb61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237251840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784756125.316656:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756125.316724:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff89135178f480 going to sleep for 11 seconds 00000100:00100000:2.0:1784756125.317073:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237251840 00000100:00100000:2.0:1784756125.317083:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237251840 00000100:00100000:2.0:1784756125.317148:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1784756125.317159:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346888050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+16:5772:x1871452237251840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784756125.317176:0:5768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756125.317193:0:5768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891350390e00/0xc0f560bd53f90f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0f560bd53f90ef expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756125.317234:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891350390e00/0xc0f560bd53f90f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0f560bd53f90ef expref: 17 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756125.317265:0:5768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891350390e00/0xc0f560bd53f90f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f90ef expref: 17 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756125.317275:0:5768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891350390e00, rc 0) 00000100:00100000:2.0:1784756125.317324:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346888050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+17:5772:x1871452237251840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756125.317343:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1784756125.331653:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136cb61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237251840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784756125.331688:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff89134151b400/0xc0f560bd53f90ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f90f6 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756125.331721:0:5772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff89134151b400/0xc0f560bd53f90ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0f560bd53f90f6 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756125.331803:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136cb61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237251968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784756125.331869:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756125.331934:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff89135178f480 going to sleep for 11 seconds 00000100:00100000:2.0:1784756125.333011:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237251968 00000100:00100000:2.0:1784756125.333023:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237251968 00000100:00100000:2.0:1784756125.333089:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1784756125.333101:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+17:5772:x1871452237251968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784756125.333726:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+17:5772:x1871452237251968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 626us (1855us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756125.333737:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1784756125.336607:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136cb61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237251968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784756125.336682:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136cb61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237252096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784756125.336785:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756125.336831:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff89135178f480 going to sleep for 11 seconds 00000100:00100000:3.0:1784756125.336850:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237252096 00000100:00100000:3.0:1784756125.336855:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237252096 00000100:00100000:3.0:1784756125.336901:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1784756125.336909:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+17:5772:x1871452237252096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784756125.337140:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+17:5772:x1871452237252096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 230us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756125.337149:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1784756125.337209:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136cb61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237252096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784756125.338085:0:11359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1784756125.338156:0:5772:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1784756125.338174:0:5772:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784756125.338186:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff89134151b400/0xc0f560bd53f90ef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f90f6 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756125.338198:0:5772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff89134151b400/0xc0f560bd53f90ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f90f6 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784756125.338962:0:5772:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784756125.338967:0:5772:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff891342e9d800 from 7 10000000:01000000:3.0:1784756125.338972:0:5772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784756125.339012:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff89134151b200/0xc0f560bd53f90fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756125.339023:0:5772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff89134151b200/0xc0f560bd53f90fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756125.339034:0:5772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff89134151b200/0xc0f560bd53f90fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756125.339061:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136cb61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237252224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784756125.339129:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756125.339212:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff89135178f900 going to sleep for 11 seconds 00000100:00100000:2.0:1784756125.345900:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237252224 00000100:00100000:2.0:1784756125.345955:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237252224 00000100:00100000:2.0:1784756125.346030:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1784756125.346042:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+17:5772:x1871452237252224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784756125.346059:0:5767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756125.346081:0:5767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891350391e00/0xc0f560bd53f9104 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0f560bd53f90fd expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756125.346110:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891350391e00/0xc0f560bd53f9104 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0f560bd53f90fd expref: 18 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756125.346122:0:5767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891350391e00/0xc0f560bd53f9104 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f90fd expref: 18 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756125.346151:0:5767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891350391e00, rc 0) 00000100:00100000:2.0:1784756125.346461:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+18:5772:x1871452237252224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 421us (7332us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756125.346469:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1784756125.347326:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136cb61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237252224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784756125.347508:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff89134151b200/0xc0f560bd53f90fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f9104 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756125.347520:0:5772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff89134151b200/0xc0f560bd53f90fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0f560bd53f9104 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756125.347589:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136cb61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237252352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784756125.347630:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756125.347673:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff89135178f900 going to sleep for 11 seconds 00000100:00100000:2.0:1784756125.349360:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237252352 00000100:00100000:2.0:1784756125.349373:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237252352 00000100:00100000:2.0:1784756125.349461:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1784756125.349472:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+18:5772:x1871452237252352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784756125.349790:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+18:5772:x1871452237252352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 319us (2158us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756125.349799:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1784756125.350107:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136cb61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237252352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784756125.350162:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136cb61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237252480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784756125.351859:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756125.351942:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff89135178f900 going to sleep for 11 seconds 00000100:00100000:2.0:1784756125.352247:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237252480 00000100:00100000:2.0:1784756125.352257:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237252480 00000100:00100000:2.0:1784756125.352315:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1784756125.352325:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+18:5772:x1871452237252480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784756125.352637:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+18:5772:x1871452237252480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 313us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756125.352647:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1784756125.352892:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136cb61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237252480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784756125.360886:0:11360:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1784756125.361283:0:5772:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1784756125.361305:0:5772:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784756125.361317:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff89134151b200/0xc0f560bd53f90fd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f9104 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756125.361548:0:5772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff89134151b200/0xc0f560bd53f90fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f9104 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784756125.361560:0:5772:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784756125.361563:0:5772:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8913516af000 from 7 10000000:01000000:0.0:1784756125.361565:0:5772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784756125.361605:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff891342bae200/0xc0f560bd53f910b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756125.361613:0:5772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff891342bae200/0xc0f560bd53f910b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756125.361623:0:5772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff891342bae200/0xc0f560bd53f910b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756125.361648:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136fa49c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237252608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784756125.361716:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756125.361770:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff89136c8a1780 going to sleep for 11 seconds 00000100:00100000:0.0:1784756125.361790:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237252608 00000100:00100000:0.0:1784756125.361796:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237252608 00000100:00100000:0.0:1784756125.361831:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1784756125.361840:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+18:5772:x1871452237252608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784756125.361853:0:5768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756125.361865:0:5768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891342baf200/0xc0f560bd53f9112 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0f560bd53f910b expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756125.361888:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891342baf200/0xc0f560bd53f9112 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc0f560bd53f910b expref: 19 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756125.361899:0:5768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891342baf200/0xc0f560bd53f9112 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc0f560bd53f910b expref: 19 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756125.361908:0:5768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891342baf200, rc 0) 00000100:00100000:0.0:1784756125.361952:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+19:5772:x1871452237252608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756125.361959:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1784756125.362003:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136fa49c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237252608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784756125.362016:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff891342bae200/0xc0f560bd53f910b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f9112 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756125.362025:0:5772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff891342bae200/0xc0f560bd53f910b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc0f560bd53f9112 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756125.362066:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136fa49c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237252736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784756125.362087:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756125.362105:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff89136c8a1780 going to sleep for 11 seconds 00000100:00100000:0.0:1784756125.362115:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237252736 00000100:00100000:0.0:1784756125.362118:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237252736 00000100:00100000:0.0:1784756125.362140:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1784756125.362145:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346889050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+19:5772:x1871452237252736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784756125.365181:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346889050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a5739ad-a70a-4582-8756-59cdd498af45+19:5772:x1871452237252736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3026us (3084us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756125.365197:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1784756125.367513:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136fa49c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237252736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784756125.367583:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136fa49c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237252864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784756125.367664:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756125.367710:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff89136c8a1780 going to sleep for 11 seconds 00000100:00100000:2.0:1784756125.370441:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237252864 00000100:00100000:2.0:1784756125.370457:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237252864 00000100:00100000:2.0:1784756125.370523:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1784756125.370533:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+19:5772:x1871452237252864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784756125.370761:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+19:5772:x1871452237252864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 230us (3097us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756125.370775:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1784756125.371861:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136fa49c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3a5739ad-a70a-4582-8756-59cdd498af45:5772:1871452237252864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784756125.376282:0:11361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1784756125.377770:0:5772:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1784756125.377804:0:5772:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784756125.377817:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff891342bae200/0xc0f560bd53f910b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f9112 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756125.377832:0:5772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff891342bae200/0xc0f560bd53f910b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc0f560bd53f9112 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756125.788993:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1784756125.789083:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228823936 00000100:00100000:0.0:1784756125.789093:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228823936 00000100:00100000:0.0:1784756125.789156:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 228 00000100:00100000:0.0:1784756125.789166:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+9:5565:x1871452228823936:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784756125.789182:0:5767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756125.789209:0:5767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff891342baf800/0xc0f560bd53f9119 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9935e598575ac49 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756125.789243:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff891342baf800/0xc0f560bd53f9119 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac49 expref: 10 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756125.789255:0:5767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff891342baf800/0xc0f560bd53f9119 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac49 expref: 10 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756125.789265:0:5767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891342baf800, rc 0) 00000100:00100000:0.0:1784756125.789333:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+10:5565:x1871452228823936:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 Request processed in 168us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756125.789341:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 228 00000100:00100000:1.0:1784756125.799517:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1784756125.800384:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228824064 00000100:00100000:2.0:1784756125.800396:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228824064 00000100:00100000:2.0:1784756125.800480:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 229 00000100:00100000:2.0:1784756125.800491:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e891795-8b87-4754-b411-3420f9834f05+10:5565:x1871452228824064:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784756125.800832:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e891795-8b87-4754-b411-3420f9834f05+10:5565:x1871452228824064:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 Request processed in 342us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756125.800841:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 229 00000100:00100000:1.0:1784756125.807401:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1784756125.807461:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228824192 00000100:00100000:1.0:1784756125.807472:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228824192 00000100:00100000:1.0:1784756125.807524:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 230 00000100:00100000:1.0:1784756125.807534:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+10:5565:x1871452228824192:12345-192.168.202.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784756125.807752:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+10:5565:x1871452228824192:12345-192.168.202.41@tcp:503:ll_cfg_requeue.0 Request processed in 219us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756125.807761:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 230 00010000:00010000:1.0:1784756126.067711:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756126.517016:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136fa4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237253376:0@lo:400:kworker.0 00000100:00100000:0.0:1784756126.517086:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756126.517142:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1784756126.517148:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136fa49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a5739ad-a70a-4582-8756-59cdd498af45:3292:1871452237252992:0@lo:400:kworker.0 00000100:00100000:0.0:1784756126.517177:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756126.517202:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136fa48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3292:1871452237253504:0@lo:400:kworker.0 00000100:00100000:0.0:1784756126.517227:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756126.517255:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136fa48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3290:1871452237253120:0@lo:400:kworker.0 00000100:00100000:0.0:1784756126.517276:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756126.517290:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136fa4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237253632:0@lo:400:kworker.0 00000100:00100000:0.0:1784756126.517309:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756126.517327:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784756126.517332:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136fa49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3290:1871452237253248:0@lo:400:kworker.0 00000100:00100000:0.0:1784756126.517354:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756126.517392:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237253376 00000100:00100000:0.0:1784756126.517400:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237253376 00000100:00100000:0.0:1784756126.517468:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237253632 00000100:00100000:0.0:1784756126.517472:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237253632 00000100:00100000:0.0:1784756126.517492:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784756126.517500:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136fa49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237253376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756126.517555:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136fa49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237253376:12345-0@lo:400:kworker.0 Request processed in 55us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756126.517562:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784756126.517581:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784756126.517587:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136fa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3290:x1871452237253632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756126.517618:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136fa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3290:x1871452237253632:12345-0@lo:400:kworker.0 Request processed in 31us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756126.517624:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784756126.517643:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237253504 00000100:00100000:0.0:1784756126.517646:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237253504 00000100:00100000:0.0:1784756126.517673:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237253120 00000100:00100000:0.0:1784756126.517675:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237253120 00000100:00100000:0.0:1784756126.517689:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237253248 00000100:00100000:0.0:1784756126.517691:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237253248 00000100:00100000:0.0:1784756126.517706:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1784756126.517712:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136fa48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1871452237253504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756126.517744:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136fa48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1871452237253504:12345-0@lo:400:kworker.0 Request processed in 32us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756126.517751:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1784756126.517763:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1784756126.517769:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136fa48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1871452237253120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756126.517936:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1784756126.517946:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136fa4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1871452237253248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756126.517980:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136fa4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1871452237253248:12345-0@lo:400:kworker.0 Request processed in 37us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756126.517986:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:3.0:1784756126.518004:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784756126.518008:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784756126.518010:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784756126.518569:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136fa48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1871452237253120:12345-0@lo:400:kworker.0 Request processed in 799us (1290us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756126.518586:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1784756126.518644:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136fa49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3290:1871452237253248:0@lo:400:kworker.0 00000100:00100000:0.0:1784756126.518657:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136fa48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3290:1871452237253120:0@lo:400:kworker.0 00010000:00080000:0.0:1784756126.518668:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136fa4b480 x1871452237253632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756126.518678:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136fa4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237253632:0@lo:400:kworker.0 00000100:00100000:0.0:1784756126.518718:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136fa48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3292:1871452237253504:0@lo:400:kworker.0 00010000:00080000:0.0:1784756126.518728:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136fa4a680 x1871452237253376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756126.518736:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136fa4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237253376:0@lo:400:kworker.0 00000100:00100000:3.0:1784756126.520184:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237252992 00000100:00100000:3.0:1784756126.520197:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237252992 00000100:00100000:3.0:1784756126.520246:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1784756126.520255:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134688a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+19:3292:x1871452237252992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756126.520344:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134688a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+19:3292:x1871452237252992:12345-0@lo:400:kworker.0 Request processed in 89us (3166us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756126.520350:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1784756126.521583:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136fa49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a5739ad-a70a-4582-8756-59cdd498af45:3292:1871452237252992:0@lo:400:kworker.0 00000100:00100000:2.0:1784756126.522681:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136bd89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3291:1871452237253760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784756126.522744:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756126.522812:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237253760 00000100:00100000:2.0:1784756126.522818:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237253760 00000100:00100000:2.0:1784756126.522856:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784756126.522863:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136bd89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1871452237253760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784756126.522894:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756126.522944:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136bd89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1871452237253760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756126.522951:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1784756126.522989:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136bd89180 x1871452237253760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756142 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756126.523006:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136bd89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3291:1871452237253760:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784756127.095659:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756127.259724:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1784756127.259771:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1784756127.260071:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228824320 00000100:00100000:3.0:1784756127.260081:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228824320 00000100:00100000:3.0:1784756127.260136:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 232 00000100:00100000:3.0:1784756127.260146:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891346889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+10:2354:x1871452228824320:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1784756127.260225:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891346889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+10:2354:x1871452228824320:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 80us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756127.260249:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 232 00000100:00100000:3.0:1784756127.260477:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228824448 00000100:00100000:3.0:1784756127.260482:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228824448 00000100:00100000:3.0:1784756127.260533:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 91 00000100:00100000:3.0:1784756127.260648:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f83a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2354:x1871452228824448:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1784756127.260683:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f83a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2354:x1871452228824448:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 143us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756127.260690:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 91 00000100:00080000:3.0:1784756127.260707:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784756128.116261:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784756128.713150:0:11531:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1784756129.079538:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784756129.079568:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136bd89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1871452237253888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784756129.079652:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756129.080231:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237253888 00000100:00100000:2.0:1784756129.080248:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237253888 00000100:00100000:2.0:1784756129.080328:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784756129.080339:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136cb61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1871452237253888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784756129.080399:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756129.080491:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136cb61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1871452237253888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 153us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756129.080499:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1784756129.080652:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136bd89180 x1871452237253888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756145 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756129.080684:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136bd89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1871452237253888:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1784756129.080861:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784756129.139677:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756130.163701:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756131.188317:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756131.635784:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784756131.635810:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136bd88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237254016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784756131.635922:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756131.636477:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136bd89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a5739ad-a70a-4582-8756-59cdd498af45:3290:1871452237254144:0@lo:400:kworker.0 00000100:00100000:2.0:1784756131.636513:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756131.636566:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136bd8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3291:1871452237254272:0@lo:400:kworker.0 00000100:00100000:2.0:1784756131.636593:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756131.636627:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237254272 00000100:00100000:2.0:1784756131.636635:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237254272 00000100:00100000:2.0:1784756131.636683:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1784756131.636692:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136bd88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1871452237254272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756131.636749:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136bd88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1871452237254272:12345-0@lo:400:kworker.0 Request processed in 57us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756131.636756:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1784756131.636798:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136bd8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3291:1871452237254272:0@lo:400:kworker.0 00000100:00100000:2.0:1784756131.636842:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136bd8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3292:1871452237254400:0@lo:400:kworker.0 00000100:00100000:2.0:1784756131.636878:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756131.636905:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237254400 00000100:00100000:2.0:1784756131.636908:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237254400 00000100:00100000:2.0:1784756131.636933:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1784756131.636939:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136bd8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1871452237254400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756131.636970:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136bd8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1871452237254400:12345-0@lo:400:kworker.0 Request processed in 31us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756131.636976:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1784756131.637015:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136bd8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3292:1871452237254400:0@lo:400:kworker.0 00000100:00100000:2.0:1784756131.637041:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784756131.637048:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136bd8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237254528:0@lo:400:kworker.0 00000100:00100000:2.0:1784756131.637073:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756131.637100:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237254528 00000100:00100000:2.0:1784756131.637104:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237254528 00000100:00100000:2.0:1784756131.637127:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784756131.637134:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136bd89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237254528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756131.637172:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136bd89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237254528:12345-0@lo:400:kworker.0 Request processed in 39us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756131.637179:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1784756131.637204:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136bd8aa00 x1871452237254528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756131.637214:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136bd8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237254528:0@lo:400:kworker.0 00000100:00100000:2.0:1784756131.637247:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136bd8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3290:1871452237254656:0@lo:400:kworker.0 00000100:00100000:2.0:1784756131.637269:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756131.638556:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237254016 00000100:00100000:3.0:1784756131.638567:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237254016 00000100:00100000:3.0:1784756131.638622:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784756131.638631:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136fa49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237254016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784756131.638670:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784756131.638748:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136fa49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237254016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (2825us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756131.638755:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784756131.638787:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237254144 00000100:00100000:3.0:1784756131.638791:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237254144 00000100:00100000:3.0:1784756131.638817:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1784756131.638837:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+19:3290:x1871452237254144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756131.638889:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+19:3290:x1871452237254144:12345-0@lo:400:kworker.0 Request processed in 54us (2375us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756131.638896:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00080000:3.0:1784756131.638925:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784756131.638929:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784756131.638932:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784756131.638942:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237254656 00000100:00100000:3.0:1784756131.638945:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237254656 00000100:00100000:3.0:1784756131.638978:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1784756131.638985:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136bd8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1871452237254656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756131.639022:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136bd8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1871452237254656:12345-0@lo:400:kworker.0 Request processed in 38us (1752us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756131.639029:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1784756131.639056:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784756131.639091:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136bd8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3290:1871452237254656:0@lo:400:kworker.0 00000100:00100000:3.0:1784756131.639101:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136bd89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3a5739ad-a70a-4582-8756-59cdd498af45:3290:1871452237254144:0@lo:400:kworker.0 00010000:00080000:1.0:1784756131.639214:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136bd88700 x1871452237254016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756147 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756131.639231:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136bd88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237254016:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784756132.215910:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756132.385172:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1784756132.385239:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1784756132.385601:0:8296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228824704 00000100:00100000:2.0:1784756132.385612:0:8296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228824704 00000100:00100000:2.0:1784756132.385684:0:8296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 95 00000100:00100000:2.0:1784756132.385694:0:8296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136cb63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2354:x1871452228824704:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1784756132.385770:0:8296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136cb63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2354:x1871452228824704:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 77us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756132.385778:0:8296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 95 00000100:00080000:3.0:1784756132.385863:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784756132.385922:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228824576 00000100:00100000:1.0:1784756132.385927:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228824576 00000100:00100000:1.0:1784756132.385967:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 234 00000100:00100000:1.0:1784756132.385974:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+10:2354:x1871452228824576:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1784756132.386001:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+10:2354:x1871452228824576:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 28us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756132.386006:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 234 00000001:02000400:3.0:1784756132.514094:0:11631:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity: finish setup 17:35:31 (1784756131) === 00000100:00100000:1.0:1784756132.809570:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1784756132.810036:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228824832 00000100:00100000:3.0:1784756132.810046:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228824832 00000100:00100000:3.0:1784756132.810116:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 10 00000100:00100000:3.0:1784756132.810125:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:7600:x1871452228824832:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:3.0:1784756132.810154:0:5774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784756132.810228:0:5774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89134151bc00/0xc0f560bd53f9120 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9935e598575ac50 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756132.810304:0:5774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89134151b000/0xc0f560bd53f9127 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756132.810317:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89134151b000/0xc0f560bd53f9127 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756132.810330:0:5774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89134151b000/0xc0f560bd53f9127 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756132.810344:0:5774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89134151a600/0xc0f560bd53f912e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756132.810350:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89134151a600/0xc0f560bd53f912e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756132.810356:0:5774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89134151a600/0xc0f560bd53f912e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756132.810686:0:5774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89134151b000/0xc0f560bd53f9127 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756132.810694:0:5774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89134151b000/0xc0f560bd53f9127 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756132.810700:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89134151b000/0xc0f560bd53f9127 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756132.810717:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89134151b000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784756132.810721:0:5774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89134151b000/0xc0f560bd53f9127 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756132.811155:0:5774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89134151b000/0xc0f560bd53f9127 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756132.811168:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891359d6d100) 00010000:00010000:3.0:1784756132.811172:0:5774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784756132.811176:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89134151b000/0xc0f560bd53f9127 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756132.811181:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89134151b000/0xc0f560bd53f9127 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756132.811195:0:5774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89134151a600/0xc0f560bd53f912e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756132.811201:0:5774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89134151a600/0xc0f560bd53f912e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756132.811206:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89134151a600/0xc0f560bd53f912e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756132.811211:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89134151a600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784756132.811213:0:5774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89134151a600/0xc0f560bd53f912e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756132.811219:0:5774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89134151a600/0xc0f560bd53f912e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756132.811226:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x54ef8a6e (ffff891359d6da00) 00010000:00010000:3.0:1784756132.811229:0:5774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784756132.811231:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89134151a600/0xc0f560bd53f912e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756132.811245:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89134151a600/0xc0f560bd53f912e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756132.811537:0:5774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89134151bc00/0xc0f560bd53f9120 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac50 expref: 7 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756132.811549:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891359d6d100) 00010000:00010000:3.0:1784756132.811552:0:5774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784756132.811556:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89134151bc00/0xc0f560bd53f9120 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac50 expref: 7 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756132.811566:0:5774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89134151bc00, rc 0) 00000100:00100000:3.0:1784756132.812941:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:7600:x1871452228824832:12345-192.168.202.41@tcp:101:bash.0 Request processed in 2808us (3375us total) trans 0 rc 301/301 00000100:00100000:3.0:1784756132.812952:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 10 00000100:00100000:3.0:1784756132.817987:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1784756132.818071:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228824960 00000100:00100000:2.0:1784756132.818082:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228824960 00000100:00100000:2.0:1784756132.818164:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 11 00000100:00100000:2.0:1784756132.818174:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136cb60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:7600:x1871452228824960:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:2.0:1784756132.818194:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756132.818218:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891350390000/0xc0f560bd53f9135 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9935e598575ac57 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.818286:0:5776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891350391600/0xc0f560bd53f913c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.818300:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891350391600/0xc0f560bd53f913c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.818312:0:5776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891350391600/0xc0f560bd53f913c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.818367:0:5776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891350390200/0xc0f560bd53f9143 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.818375:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891350390200/0xc0f560bd53f9143 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.818382:0:5776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891350390200/0xc0f560bd53f9143 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.818806:0:5776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891350391600/0xc0f560bd53f913c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.818815:0:5776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891350391600/0xc0f560bd53f913c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.818822:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891350391600/0xc0f560bd53f913c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.818836:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891350391600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784756132.818841:0:5776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891350391600/0xc0f560bd53f913c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.818848:0:5776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891350391600/0xc0f560bd53f913c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.818871:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891359d6d100) 00010000:00010000:2.0:1784756132.818874:0:5776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784756132.818878:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891350391600/0xc0f560bd53f913c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.818884:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891350391600/0xc0f560bd53f913c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.818894:0:5776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891350390200/0xc0f560bd53f9143 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.818901:0:5776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891350390200/0xc0f560bd53f9143 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.818906:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891350390200/0xc0f560bd53f9143 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.818911:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891350390200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784756132.818914:0:5776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891350390200/0xc0f560bd53f9143 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.818919:0:5776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891350390200/0xc0f560bd53f9143 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.818936:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x77bdd2c7 (ffff891351091a00) 00010000:00010000:2.0:1784756132.818939:0:5776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784756132.818941:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891350390200/0xc0f560bd53f9143 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.818948:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891350390200/0xc0f560bd53f9143 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.819105:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891350390000/0xc0f560bd53f9135 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac57 expref: 7 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.819116:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891359d6d100) 00010000:00010000:2.0:1784756132.819118:0:5776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784756132.819122:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891350390000/0xc0f560bd53f9135 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac57 expref: 7 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.819131:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891350390000, rc 0) 00000100:00100000:2.0:1784756132.819198:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136cb60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:7600:x1871452228824960:12345-192.168.202.41@tcp:101:bash.0 Request processed in 1024us (1220us total) trans 0 rc 301/301 00000100:00100000:2.0:1784756132.819205:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 11 00000100:00100000:2.0:1784756132.824046:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1784756132.824337:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228825088 00000100:00100000:3.0:1784756132.824346:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228825088 00000100:00100000:3.0:1784756132.824387:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 1 00000100:00100000:3.0:1784756132.824394:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136bd89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:7600:x1871452228825088:12345-192.168.202.41@tcp:37:bash.0 00000100:00100000:2.0:1784756132.827531:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136bd89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:7600:x1871452228825088:12345-192.168.202.41@tcp:37:bash.0 Request processed in 3127us (3487us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756132.827549:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 1 00000100:00100000:3.0:1784756132.840661:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1784756132.840953:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228825216 00000100:00100000:2.0:1784756132.840974:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228825216 00000100:00100000:2.0:1784756132.841043:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 12 00000100:00100000:2.0:1784756132.841055:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136cb62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:10387:x1871452228825216:12345-192.168.202.41@tcp:101:rm.0 00010000:00010000:2.0:1784756132.841096:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756132.841122:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891350390000/0xc0f560bd53f914a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9935e598575ac5e expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.841203:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891350390200/0xc0f560bd53f9151 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.841219:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891350390200/0xc0f560bd53f9151 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.841231:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891350390200/0xc0f560bd53f9151 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.841292:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891350391600/0xc0f560bd53f9158 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.841302:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891350391600/0xc0f560bd53f9158 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.841309:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891350391600/0xc0f560bd53f9158 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.841652:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891350390200/0xc0f560bd53f9151 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.841662:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891350390200/0xc0f560bd53f9151 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.841669:0:6599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891350390200/0xc0f560bd53f9151 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.841676:0:6599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891350390200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784756132.842625:0:6599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891350390200/0xc0f560bd53f9151 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.842637:0:6599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891350390200/0xc0f560bd53f9151 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.842653:0:6599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891359d6d100) 00010000:00010000:2.0:1784756132.842656:0:6599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784756132.842661:0:6599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891350390200/0xc0f560bd53f9151 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.842668:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891350390200/0xc0f560bd53f9151 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.842756:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891350391600/0xc0f560bd53f9158 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.842763:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891350391600/0xc0f560bd53f9158 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.842769:0:6599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891350391600/0xc0f560bd53f9158 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.842775:0:6599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891350391600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784756132.842778:0:6599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891350391600/0xc0f560bd53f9158 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.842784:0:6599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891350391600/0xc0f560bd53f9158 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.842793:0:6599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3d64192e (ffff891351091a00) 00010000:00010000:2.0:1784756132.842795:0:6599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784756132.842811:0:6599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891350391600/0xc0f560bd53f9158 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.842818:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891350391600/0xc0f560bd53f9158 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.842879:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891350390000/0xc0f560bd53f914a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac5e expref: 7 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.842891:0:6599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891359d6d100) 00010000:00010000:2.0:1784756132.842893:0:6599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784756132.842897:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891350390000/0xc0f560bd53f914a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac5e expref: 7 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.842907:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891350390000, rc 0) 00000100:00100000:2.0:1784756132.843954:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136cb62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:10387:x1871452228825216:12345-192.168.202.41@tcp:101:rm.0 Request processed in 2894us (3297us total) trans 0 rc 301/301 00000100:00100000:2.0:1784756132.843977:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 12 00000100:00100000:1.0:1784756132.931564:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1784756132.931613:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1784756132.931708:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228825472 00000100:00100000:0.0:1784756132.931723:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228825472 00000100:00100000:0.0:1784756132.931790:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 0 00000100:00100000:0.0:1784756132.931801:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f83bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:10394:x1871452228825472:12345-192.168.202.41@tcp:700:mkdir.0 00000100:00100000:0.0:1784756132.931931:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f83bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:10394:x1871452228825472:12345-192.168.202.41@tcp:700:mkdir.0 Request processed in 131us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756132.931956:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 0 00000100:00100000:3.0:1784756132.932078:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228825344 00000100:00100000:3.0:1784756132.932084:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228825344 00000100:00100000:3.0:1784756132.932171:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 13 00000100:00100000:3.0:1784756132.932179:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f83a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2352:x1871452228825344:12345-192.168.202.41@tcp:41:mkdir.0 00000004:00000024:3.0:1784756132.932219:0:5775:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1784756132.932316:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f83a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2352:x1871452228825344:12345-192.168.202.41@tcp:41:mkdir.0 Request processed in 137us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756132.932323:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 13 00000100:00100000:1.0:1784756132.936434:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1784756132.936664:0:8296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228825728 00000100:00100000:0.0:1784756132.936674:0:8296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228825728 00000100:00100000:0.0:1784756132.936766:0:8296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 14 00000100:00100000:0.0:1784756132.936775:0:8296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f83b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:10394:x1871452228825728:12345-192.168.202.41@tcp:36:mkdir.0 00010000:00010000:0.0:1784756132.936832:0:8296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784756132.936873:0:8296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89134151ac00/0xc0f560bd53f9032 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac2d expref: 6 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756132.936892:0:8296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891359d6d100) 00010000:00010000:0.0:1784756132.936903:0:8296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784756132.937188:0:8296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891342baee00/0xc0f560bd53f915f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756132.937568:0:8296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891342baee00/0xc0f560bd53f915f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756132.937583:0:8296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891342baee00/0xc0f560bd53f915f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756132.937643:0:8296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891342baf400/0xc0f560bd53f9166 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756132.937652:0:8296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891342baf400/0xc0f560bd53f9166 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756132.937658:0:8296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891342baf400/0xc0f560bd53f9166 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784756132.939893:0:8296:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:0.0:1784756132.939919:0:8296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891342baee00/0xc0f560bd53f915f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756132.939931:0:8296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891342baee00/0xc0f560bd53f915f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756132.939939:0:8296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891342baee00/0xc0f560bd53f915f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756132.939947:0:8296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891342baee00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784756132.939951:0:8296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891342baee00/0xc0f560bd53f915f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756132.939960:0:8296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891342baee00/0xc0f560bd53f915f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756132.939977:0:8296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89134803d900) 00010000:00010000:0.0:1784756132.939981:0:8296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784756132.939987:0:8296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891342baee00/0xc0f560bd53f915f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756132.939994:0:8296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891342baee00/0xc0f560bd53f915f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784756132.940014:0:8296:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000aea8742a reply state 000000003a0149f7 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff891342baf400/0xc0f560bd53f9166 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756132.940023:0:8296:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784756132.940363:0:8296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f83b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:391dd9f2-6bf0-4674-aedd-25845b6bf878+7:10394:x1871452228825728:12345-192.168.202.41@tcp:36:mkdir.0 Request processed in 3584us (3951us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1784756132.940373:0:8296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 14 00010000:00010000:2.0:1784756132.947401:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff891342baf400/0xc0f560bd53f9166 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.947445:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891342baf400/0xc0f560bd53f9166 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.947453:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891342baf400/0xc0f560bd53f9166 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.947460:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891342baf400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784756132.947465:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891342baf400/0xc0f560bd53f9166 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.947490:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891342baf400/0xc0f560bd53f9166 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.947509:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff89134803d300) 00010000:00010000:2.0:1784756132.947512:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784756132.947518:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891342baf400/0xc0f560bd53f9166 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.947525:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891342baf400/0xc0f560bd53f9166 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756132.948588:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1784756132.948678:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228825856 00000100:00100000:2.0:1784756132.948688:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228825856 00000100:00100000:2.0:1784756132.948776:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 15 00000100:00100000:2.0:1784756132.948787:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:10395:x1871452228825856:12345-192.168.202.41@tcp:101:chmod.0 00010000:00010000:2.0:1784756132.948809:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756132.948830:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891350390200/0xc0f560bd53f916d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9935e598575ac65 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.948913:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891350390c00/0xc0f560bd53f9174 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.948928:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891350390c00/0xc0f560bd53f9174 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.948938:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891350390c00/0xc0f560bd53f9174 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784756132.949002:0:6599:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1784756132.949016:0:6599:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1784756132.949060:0:6599:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891350390c00/0xc0f560bd53f9174 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.949086:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891350390200/0xc0f560bd53f916d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac65 expref: 8 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.949104:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891350390c00/0xc0f560bd53f9174 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac65 expref: 7 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.949113:0:6599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891351091a00) 00010000:00010000:2.0:1784756132.949116:0:6599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784756132.949119:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891350390c00, rc 0) 00000100:00100000:2.0:1784756132.949481:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:391dd9f2-6bf0-4674-aedd-25845b6bf878+7:10395:x1871452228825856:12345-192.168.202.41@tcp:101:chmod.0 Request processed in 694us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756132.949490:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 15 00000100:00100000:0.0:1784756132.951724:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1784756132.951812:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228826112 00000100:00100000:3.0:1784756132.951822:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228826112 00000100:00100000:3.0:1784756132.951892:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:3.0:1784756132.951902:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136fa4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:391dd9f2-6bf0-4674-aedd-25845b6bf878+7:10395:x1871452228826112:12345-192.168.202.41@tcp:36:chmod.0 00010000:00010000:3.0:1784756132.951955:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784756132.951980:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891350390c00/0xc0f560bd53f9174 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac65 expref: 7 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756132.951998:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891351091a00) 00010000:00010000:3.0:1784756132.952008:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784756132.952031:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89134151bc00/0xc0f560bd53f917b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756132.952044:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89134151bc00/0xc0f560bd53f917b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756132.952053:0:5775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89134151bc00/0xc0f560bd53f917b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784756132.952602:0:5775:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002aaa925c reply state 000000002328b31c transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff89134151bc00/0xc0f560bd53f917b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756132.952614:0:5775:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784756132.952630:0:5775:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1784756132.952708:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136fa4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:391dd9f2-6bf0-4674-aedd-25845b6bf878+8:10395:x1871452228826112:12345-192.168.202.41@tcp:36:chmod.0 Request processed in 806us (991us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1784756132.952715:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 16 00010000:00010000:2.0:1784756132.955374:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89134151bc00/0xc0f560bd53f917b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.955400:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89134151bc00/0xc0f560bd53f917b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.955407:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89134151bc00/0xc0f560bd53f917b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.955463:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89134151bc00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784756132.955468:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89134151bc00/0xc0f560bd53f917b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.955476:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89134151bc00/0xc0f560bd53f917b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.955508:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891359d6da00) 00010000:00010000:2.0:1784756132.955510:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784756132.955515:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89134151bc00/0xc0f560bd53f917b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.955521:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89134151bc00/0xc0f560bd53f917b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756132.972084:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1784756132.972143:0:8296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228826240 00000100:00100000:2.0:1784756132.972153:0:8296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228826240 00000100:00100000:2.0:1784756132.972376:0:8296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 17 00000100:00100000:2.0:1784756132.972397:0:8296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136fa48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:391dd9f2-6bf0-4674-aedd-25845b6bf878+7:10396:x1871452228826240:12345-192.168.202.41@tcp:101:chown.0 00010000:00010000:2.0:1784756132.972625:0:8296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756132.972652:0:8296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891350390200/0xc0f560bd53f9182 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9935e598575ac6c expref: -99 pid: 8296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.972724:0:8296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891350391800/0xc0f560bd53f9189 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.972737:0:8296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891350391800/0xc0f560bd53f9189 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.972748:0:8296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891350391800/0xc0f560bd53f9189 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784756132.972812:0:8296:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1784756132.972816:0:8296:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1784756132.972872:0:8296:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891350391800/0xc0f560bd53f9189 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.972924:0:8296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891350390200/0xc0f560bd53f9182 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac6c expref: 9 pid: 8296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.972946:0:8296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891350391800/0xc0f560bd53f9189 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac6c expref: 8 pid: 8296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.972955:0:8296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891351091700) 00010000:00010000:2.0:1784756132.972958:0:8296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784756132.972961:0:8296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891350391800, rc 0) 00000100:00100000:2.0:1784756132.973080:0:8296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136fa48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:391dd9f2-6bf0-4674-aedd-25845b6bf878+8:10396:x1871452228826240:12345-192.168.202.41@tcp:101:chown.0 Request processed in 685us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756132.973086:0:8296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 17 00000100:00100000:3.0:1784756132.980378:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1784756132.980556:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228826368 00000100:00100000:2.0:1784756132.980565:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228826368 00000100:00100000:2.0:1784756132.980616:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 18 00000100:00100000:2.0:1784756132.980626:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136cb61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:391dd9f2-6bf0-4674-aedd-25845b6bf878+8:10396:x1871452228826368:12345-192.168.202.41@tcp:101:chown.0 00010000:00010000:2.0:1784756132.980650:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756132.980673:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891350390200/0xc0f560bd53f9190 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9935e598575ac73 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.980744:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891350390800/0xc0f560bd53f9197 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.980758:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891350390800/0xc0f560bd53f9197 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.980770:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891350390800/0xc0f560bd53f9197 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.980799:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891350391000/0xc0f560bd53f919e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.980805:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891350391000/0xc0f560bd53f919e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.980809:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891350391000/0xc0f560bd53f919e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.980903:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891350390a00/0xc0f560bd53f91a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.980910:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891350390a00/0xc0f560bd53f91a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.980917:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891350390a00/0xc0f560bd53f91a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784756132.980954:0:6599:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1784756132.980957:0:6599:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784756132.980973:0:6599:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891350390a00/0xc0f560bd53f91a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.980983:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891350390800/0xc0f560bd53f9197 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.980987:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891350390800/0xc0f560bd53f9197 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.980992:0:6599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891350390800/0xc0f560bd53f9197 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.981003:0:6599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891350390800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784756132.981006:0:6599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891350390800/0xc0f560bd53f9197 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.981021:0:6599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891350390800/0xc0f560bd53f9197 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.981031:0:6599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891351091700) 00010000:00010000:2.0:1784756132.981033:0:6599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784756132.981038:0:6599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891350390800/0xc0f560bd53f9197 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.981044:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891350390800/0xc0f560bd53f9197 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.981058:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891350391000/0xc0f560bd53f919e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.981064:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891350391000/0xc0f560bd53f919e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.981069:0:6599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891350391000/0xc0f560bd53f919e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.981074:0:6599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891350391000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784756132.981077:0:6599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891350391000/0xc0f560bd53f919e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.981083:0:6599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891350391000/0xc0f560bd53f919e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.981098:0:6599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff891351091c00) 00010000:00010000:2.0:1784756132.981100:0:6599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784756132.981102:0:6599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891350391000/0xc0f560bd53f919e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.981106:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891350391000/0xc0f560bd53f919e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.981128:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891350390200/0xc0f560bd53f9190 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac73 expref: 10 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.981136:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891350390a00/0xc0f560bd53f91a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac73 expref: 9 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756132.981141:0:6599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff891351091900) 00010000:00010000:2.0:1784756132.981143:0:6599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784756132.981144:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891350390a00, rc 0) 00000100:00100000:2.0:1784756132.981190:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136cb61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:391dd9f2-6bf0-4674-aedd-25845b6bf878+9:10396:x1871452228826368:12345-192.168.202.41@tcp:101:chown.0 Request processed in 566us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756132.981194:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 18 00000100:00100000:1.0:1784756132.985043:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1784756132.985181:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228826624 00000100:00100000:0.0:1784756132.985189:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228826624 00000100:00100000:0.0:1784756132.985252:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 19 00000100:00100000:0.0:1784756132.985263:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+9:10396:x1871452228826624:12345-192.168.202.41@tcp:36:chown.0 00010000:00010000:0.0:1784756132.985322:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784756132.985349:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891350390a00/0xc0f560bd53f91a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac73 expref: 9 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756132.985368:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff891351091900) 00010000:00010000:0.0:1784756132.985377:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784756132.985402:0:5774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891342bae600/0xc0f560bd53f91ac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756132.985446:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891342bae600/0xc0f560bd53f91ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756132.985455:0:5774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891342bae600/0xc0f560bd53f91ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784756133.007703:0:5796:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:3.0:1784756133.007768:0:5774:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000a6fe9b8 reply state 0000000005c1c45f transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff891342bae600/0xc0f560bd53f91ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756133.007783:0:5774:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784756133.008121:0:5774:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:3.0:1784756133.008293:0:5774:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1784756133.008313:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+7:10396:x1871452228826624:12345-192.168.202.41@tcp:36:chown.0 Request processed in 23046us (23275us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1784756133.008323:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 19 00010000:00010000:0.0:1784756133.011485:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff891342bae600/0xc0f560bd53f91ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.011504:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891342bae600/0xc0f560bd53f91ac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.011512:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891342bae600/0xc0f560bd53f91ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.011518:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891342bae600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784756133.011523:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891342bae600/0xc0f560bd53f91ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.011551:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891342bae600/0xc0f560bd53f91ac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.011572:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff89134803d900) 00010000:00010000:0.0:1784756133.011576:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784756133.011582:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891342bae600/0xc0f560bd53f91ac lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.011588:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891342bae600/0xc0f560bd53f91ac lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756133.024898:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1784756133.025642:0:8296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228826752 00000100:00100000:2.0:1784756133.025652:0:8296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228826752 00000100:00100000:2.0:1784756133.025720:0:8296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 20 00000100:00100000:2.0:1784756133.025727:0:8296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f83aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:10397:x1871452228826752:12345-192.168.202.41@tcp:101:touch.500 00010000:00010000:2.0:1784756133.025746:0:8296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756133.025764:0:8296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891350390200/0xc0f560bd53f91b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9935e598575ac7a expref: -99 pid: 8296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784756133.028302:0:8296:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2481us 00010000:00010000:1.0:1784756133.048305:0:8296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58800/0xc0f560bd53f91ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.048327:0:8296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58800/0xc0f560bd53f91ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.048351:0:8296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58800/0xc0f560bd53f91ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.048366:0:8296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59000/0xc0f560bd53f91c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.048373:0:8296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59000/0xc0f560bd53f91c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.048432:0:8296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59000/0xc0f560bd53f91c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.049038:0:8296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58a00/0xc0f560bd53f91c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.049048:0:8296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58a00/0xc0f560bd53f91c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.049056:0:8296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58a00/0xc0f560bd53f91c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784756133.049122:0:8296:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1784756133.049126:0:8296:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784756133.049199:0:8296:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58a00/0xc0f560bd53f91c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.049211:0:8296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58800/0xc0f560bd53f91ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.049217:0:8296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58800/0xc0f560bd53f91ba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.049236:0:8296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58800/0xc0f560bd53f91ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.049241:0:8296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89135fc58800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784756133.049246:0:8296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58800/0xc0f560bd53f91ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.049253:0:8296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58800/0xc0f560bd53f91ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.049264:0:8296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891351091700) 00010000:00010000:1.0:1784756133.049267:0:8296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784756133.049271:0:8296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58800/0xc0f560bd53f91ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.049277:0:8296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58800/0xc0f560bd53f91ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.049287:0:8296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59000/0xc0f560bd53f91c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.049293:0:8296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59000/0xc0f560bd53f91c1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.049297:0:8296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59000/0xc0f560bd53f91c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.049302:0:8296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89135fc59000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784756133.049304:0:8296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59000/0xc0f560bd53f91c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.049320:0:8296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59000/0xc0f560bd53f91c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.049328:0:8296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff891343cfdd00) 00010000:00010000:1.0:1784756133.049329:0:8296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784756133.049332:0:8296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59000/0xc0f560bd53f91c1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.049337:0:8296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59000/0xc0f560bd53f91c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.049374:0:8296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891350390200/0xc0f560bd53f91b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac7a expref: 8 pid: 8296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.049497:0:8296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58a00/0xc0f560bd53f91c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac7a expref: 7 pid: 8296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.049504:0:8296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff891343cfd800) 00010000:00010000:1.0:1784756133.049507:0:8296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784756133.049509:0:8296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89135fc58a00, rc 0) 00000100:00100000:1.0:1784756133.049621:0:8296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f83aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:391dd9f2-6bf0-4674-aedd-25845b6bf878+7:10397:x1871452228826752:12345-192.168.202.41@tcp:101:touch.500 Request processed in 23891us (24739us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756133.049630:0:8296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 20 00000100:00100000:0.0:1784756133.053094:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1784756133.053224:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228827008 00000100:00100000:3.0:1784756133.053233:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228827008 00000100:00100000:3.0:1784756133.053292:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 21 00000100:00100000:3.0:1784756133.053302:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136fa4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:391dd9f2-6bf0-4674-aedd-25845b6bf878+7:10397:x1871452228827008:12345-192.168.202.41@tcp:101:touch.500 00010000:00010000:3.0:1784756133.053323:0:5775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784756133.053343:0:5775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89134151a600/0xc0f560bd53f91cf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9935e598575ac81 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756133.053982:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89134151b000/0xc0f560bd53f91d6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756133.053998:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89134151b000/0xc0f560bd53f91d6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756133.054010:0:5775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89134151b000/0xc0f560bd53f91d6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756133.054050:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89134151be00/0xc0f560bd53f91dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756133.054059:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89134151be00/0xc0f560bd53f91dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756133.054073:0:5775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89134151be00/0xc0f560bd53f91dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784756133.055187:0:5775:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1784756133.055558:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89134151bc00/0xc0f560bd53f91e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756133.055573:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89134151bc00/0xc0f560bd53f91e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756133.055584:0:5775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89134151bc00/0xc0f560bd53f91e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756133.055620:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89134151b000/0xc0f560bd53f91d6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756133.055628:0:5775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89134151b000/0xc0f560bd53f91d6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756133.055635:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89134151b000/0xc0f560bd53f91d6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756133.055642:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89134151b000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784756133.055647:0:5775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89134151b000/0xc0f560bd53f91d6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756133.055655:0:5775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89134151b000/0xc0f560bd53f91d6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756133.055668:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff891343cfd800) 00010000:00010000:3.0:1784756133.055670:0:5775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784756133.055681:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89134151b000/0xc0f560bd53f91d6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756133.055688:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89134151b000/0xc0f560bd53f91d6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784756133.055702:0:5775:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004a824c10 reply state 00000000204de283 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff89134151be00/0xc0f560bd53f91dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756133.055711:0:5775:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784756133.055748:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89134151a600/0xc0f560bd53f91cf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac81 expref: 10 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756133.055763:0:5775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89134151bc00/0xc0f560bd53f91e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac81 expref: 9 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756133.055771:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff891359d6df00) 00010000:00010000:3.0:1784756133.055774:0:5775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784756133.055776:0:5775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89134151bc00, rc 0) 00000100:00100000:3.0:1784756133.057306:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136fa4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:391dd9f2-6bf0-4674-aedd-25845b6bf878+10:10397:x1871452228827008:12345-192.168.202.41@tcp:101:touch.500 Request processed in 3996us (4212us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1784756133.057318:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 21 00000100:00100000:3.0:1784756133.061012:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00010000:00010000:0.0:1784756133.061395:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89134151be00/0xc0f560bd53f91dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.061408:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89134151be00/0xc0f560bd53f91dd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.061451:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89134151be00/0xc0f560bd53f91dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.061458:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89134151be00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784756133.061463:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89134151be00/0xc0f560bd53f91dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.061472:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89134151be00/0xc0f560bd53f91dd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.061490:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x54725cf5 (ffff891359d6d700) 00010000:00010000:0.0:1784756133.061493:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784756133.061512:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89134151be00/0xc0f560bd53f91dd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.061519:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89134151be00/0xc0f560bd53f91dd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756133.061925:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228827264 00000100:00100000:1.0:1784756133.061935:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228827264 00000100:00100000:1.0:1784756133.061994:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 22 00000100:00100000:1.0:1784756133.062005:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136cb60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+9:10397:x1871452228827264:12345-192.168.202.41@tcp:36:touch.500 00010000:00010000:1.0:1784756133.062061:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784756133.062088:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89134151bc00/0xc0f560bd53f91e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac81 expref: 9 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.062169:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff891359d6df00) 00010000:00010000:1.0:1784756133.062178:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784756133.062219:0:5774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58800/0xc0f560bd53f91f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.062230:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58800/0xc0f560bd53f91f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.062239:0:5774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58800/0xc0f560bd53f91f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784756133.062359:0:5774:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f6800af4 reply state 00000000bf43d51d transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58800/0xc0f560bd53f91f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756133.062368:0:5774:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784756133.062484:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136cb60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+10:10397:x1871452228827264:12345-192.168.202.41@tcp:36:touch.500 Request processed in 480us (1481us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1784756133.062492:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 22 00010000:00010000:0.0:1784756133.064252:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58800/0xc0f560bd53f91f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.064269:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58800/0xc0f560bd53f91f2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.064276:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58800/0xc0f560bd53f91f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.064282:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89135fc58800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784756133.064286:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58800/0xc0f560bd53f91f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.064294:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58800/0xc0f560bd53f91f2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.064309:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff891343cfdd00) 00010000:00010000:0.0:1784756133.064312:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784756133.064316:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58800/0xc0f560bd53f91f2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.064322:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58800/0xc0f560bd53f91f2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756133.069810:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1784756133.069908:0:8296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228827392 00000100:00100000:1.0:1784756133.069920:0:8296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228827392 00000100:00100000:1.0:1784756133.069991:0:8296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00100000:1.0:1784756133.070003:0:8296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136cb60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:391dd9f2-6bf0-4674-aedd-25845b6bf878+9:10397:x1871452228827392:12345-192.168.202.41@tcp:101:touch.500 00010000:00010000:1.0:1784756133.070033:0:8296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784756133.070057:0:8296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59a00/0xc0f560bd53f91f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9935e598575ac88 expref: -99 pid: 8296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.070135:0:8296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59a00/0xc0f560bd53f91f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac88 expref: 10 pid: 8296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.070174:0:8296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59a00/0xc0f560bd53f91f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac88 expref: 10 pid: 8296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.070195:0:8296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff891343cfd700) 00010000:00010000:1.0:1784756133.070207:0:8296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784756133.070211:0:8296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89135fc59a00, rc 0) 00000100:00100000:1.0:1784756133.070272:0:8296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136cb60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:391dd9f2-6bf0-4674-aedd-25845b6bf878+10:10397:x1871452228827392:12345-192.168.202.41@tcp:101:touch.500 Request processed in 271us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756133.070279:0:8296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00100000:2.0:1784756133.073350:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1784756133.073392:0:9140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228827520 00000100:00100000:0.0:1784756133.073402:0:9140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228827520 00000100:00100000:0.0:1784756133.073470:0:9140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 12 00000100:00100000:0.0:1784756133.073490:0:9140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136bd88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2350:x1871452228827520:12345-192.168.202.41@tcp:8:touch.500 00010000:00080000:0.0:1784756133.073522:0:9140:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 391dd9f2-6bf0-4674-aedd-25845b6bf878@192.168.202.41@tcp t0 exp 0000000000000000 cur 250 last 0 00000020:00000080:0.0:1784756133.073552:0:9140:0:(genops.c:1406:class_connect()) connect: client 391dd9f2-6bf0-4674-aedd-25845b6bf878, cookie 0xc0f560bd53f9200 00002000:00100000:0.0:1784756133.073564:0:9140:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 391dd9f2-6bf0-4674-aedd-25845b6bf878/ffff89136c909800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136b7 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784756133.073575:0:9140:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 37, return 37 00002000:00080000:0.0:1784756133.073843:0:9140:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784756133.074012:0:9140:0:(import.c:65:import_set_state_nolock()) ffff89136c909000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784756133.074134:0:9140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136bd88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2350:x1871452228827520:12345-192.168.202.41@tcp:8:touch.500 Request processed in 643us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756133.074142:0:9140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 12 00000100:00100000:3.0:1784756133.076699:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1784756133.076751:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228827648 00000100:00100000:0.0:1784756133.076761:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228827648 00000100:00100000:0.0:1784756133.076823:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 13 00000100:00100000:0.0:1784756133.076832:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136cb62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:0:x1871452228827648:12345-192.168.202.41@tcp:2:touch.500 00000100:00080000:0.0:1784756133.077139:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1784756133.108544:0:7478:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:0.0:1784756133.108564:0:7478:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 391dd9f2-6bf0-4674-aedd-25845b6bf878 00000100:00100000:0.0:1784756133.108684:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136cb62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+5:0:x1871452228827648:12345-192.168.202.41@tcp:2:touch.500 Request processed in 31846us (31986us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1784756133.108695:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 13 00000100:00100000:1.0:1784756133.111572:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1784756133.111841:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228827904 00000100:00100000:0.0:1784756133.111862:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228827904 00000100:00100000:0.0:1784756133.112037:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 2 00000100:00100000:0.0:1784756133.112048:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:391dd9f2-6bf0-4674-aedd-25845b6bf878+10:10397:x1871452228827904:12345-192.168.202.41@tcp:35:touch.500 00000100:00100000:0.0:1784756133.112463:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:391dd9f2-6bf0-4674-aedd-25845b6bf878+11:10397:x1871452228827904:12345-192.168.202.41@tcp:35:touch.500 Request processed in 415us (898us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1784756133.112482:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 2 00000100:00100000:3.0:1784756133.123096:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1784756133.123460:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228828032 00000100:00100000:1.0:1784756133.123470:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228828032 00000100:00100000:1.0:1784756133.123531:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00100000:1.0:1784756133.123540:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136cb61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:391dd9f2-6bf0-4674-aedd-25845b6bf878+11:10398:x1871452228828032:12345-192.168.202.41@tcp:101:rm.0 00010000:00010000:1.0:1784756133.123566:0:5775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784756133.123585:0:5775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59400/0xc0f560bd53f9207 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9935e598575ac8f expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.123651:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59e00/0xc0f560bd53f920e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.123665:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59e00/0xc0f560bd53f920e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.123676:0:5775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59e00/0xc0f560bd53f920e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784756133.123757:0:5775:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1784756133.123761:0:5775:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1784756133.123800:0:5775:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59e00/0xc0f560bd53f920e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.123827:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59400/0xc0f560bd53f9207 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac8f expref: 13 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.123857:0:5775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59e00/0xc0f560bd53f920e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac8f expref: 12 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.123866:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff891343cfd800) 00010000:00010000:1.0:1784756133.123869:0:5775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784756133.123873:0:5775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89135fc59e00, rc 0) 00000100:00100000:1.0:1784756133.123947:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136cb61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:391dd9f2-6bf0-4674-aedd-25845b6bf878+12:10398:x1871452228828032:12345-192.168.202.41@tcp:101:rm.0 Request processed in 407us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756133.123954:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00100000:3.0:1784756133.127619:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1784756133.127755:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228828288 00000100:00100000:0.0:1784756133.127764:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228828288 00000100:00100000:0.0:1784756133.127823:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 25 00000100:00100000:0.0:1784756133.127833:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:391dd9f2-6bf0-4674-aedd-25845b6bf878+12:10398:x1871452228828288:12345-192.168.202.41@tcp:101:rm.0 00010000:00010000:0.0:1784756133.127865:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756133.127896:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891342bae600/0xc0f560bd53f9215 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9935e598575ac96 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784756133.128019:0:6599:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1784756133.128191:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891342bae600/0xc0f560bd53f9215 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac96 expref: 14 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.128661:0:6599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891351091700) 00010000:00010000:0.0:1784756133.128666:0:6599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784756133.128674:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891342bae600/0xc0f560bd53f9215 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac96 expref: 14 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.128690:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891342bae600, rc 0) 00000100:00100000:1.0:1784756133.128802:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:391dd9f2-6bf0-4674-aedd-25845b6bf878+13:10398:x1871452228828288:12345-192.168.202.41@tcp:101:rm.0 Request processed in 969us (1191us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1784756133.128811:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 25 00000100:00100000:2.0:1784756133.133868:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1784756133.133979:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228828416 00000100:00100000:1.0:1784756133.133988:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228828416 00000100:00100000:1.0:1784756133.134043:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 3 00000100:00100000:1.0:1784756133.134053:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136bd8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+13:10398:x1871452228828416:12345-192.168.202.41@tcp:37:rm.0 00000100:00100000:1.0:1784756133.139710:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136bd8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+13:10398:x1871452228828416:12345-192.168.202.41@tcp:37:rm.0 Request processed in 5646us (5851us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756133.139738:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 3 00000100:00100000:3.0:1784756133.149545:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1784756133.149646:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228828672 00000100:00100000:0.0:1784756133.149657:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228828672 00000100:00100000:0.0:1784756133.149721:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 4 00000100:00100000:0.0:1784756133.149731:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89134919dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:391dd9f2-6bf0-4674-aedd-25845b6bf878+13:10398:x1871452228828672:12345-192.168.202.41@tcp:35:rm.0 00000100:00100000:0.0:1784756133.150010:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89134919dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:391dd9f2-6bf0-4674-aedd-25845b6bf878+14:10398:x1871452228828672:12345-192.168.202.41@tcp:35:rm.0 Request processed in 278us (474us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1784756133.150017:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 4 00000100:00100000:2.0:1784756133.153858:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1784756133.153992:0:8296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228828928 00000100:00100000:1.0:1784756133.154002:0:8296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228828928 00000100:00100000:1.0:1784756133.154069:0:8296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 26 00000100:00100000:1.0:1784756133.154079:0:8296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136bd88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:391dd9f2-6bf0-4674-aedd-25845b6bf878+14:10398:x1871452228828928:12345-192.168.202.41@tcp:101:rm.0 00010000:00010000:1.0:1784756133.154107:0:8296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784756133.154128:0:8296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59400/0xc0f560bd53f9223 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9935e598575ac9d expref: -99 pid: 8296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.154376:0:8296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58600/0xc0f560bd53f922a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.154392:0:8296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58600/0xc0f560bd53f922a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.154404:0:8296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58600/0xc0f560bd53f922a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784756133.154524:0:8296:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1784756133.154645:0:8296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59400/0xc0f560bd53f9223 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac9d expref: 17 pid: 8296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.154664:0:8296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58600/0xc0f560bd53f922a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac9d expref: 16 pid: 8296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.154672:0:8296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff891343cfd800) 00010000:00010000:1.0:1784756133.154675:0:8296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1784756133.154679:0:8296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89135fc58600, rc 0) 00000100:00100000:1.0:1784756133.154751:0:8296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136bd88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:391dd9f2-6bf0-4674-aedd-25845b6bf878+16:10398:x1871452228828928:12345-192.168.202.41@tcp:101:rm.0 Request processed in 673us (914us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1784756133.154759:0:8296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 26 00000100:00100000:3.0:1784756133.158047:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1784756133.158561:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228829056 00000100:00100000:1.0:1784756133.158574:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228829056 00000100:00100000:1.0:1784756133.158639:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 27 00000100:00100000:1.0:1784756133.158650:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+16:10398:x1871452228829056:12345-192.168.202.41@tcp:41:rm.0 00000004:00000024:1.0:1784756133.158717:0:5774:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1784756133.158840:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+16:10398:x1871452228829056:12345-192.168.202.41@tcp:41:rm.0 Request processed in 191us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756133.158859:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 27 00000100:00100000:3.0:1784756133.161752:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1784756133.161844:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228829184 00000100:00100000:2.0:1784756133.161864:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228829184 00000100:00100000:2.0:1784756133.161933:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 28 00000100:00100000:2.0:1784756133.161943:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:391dd9f2-6bf0-4674-aedd-25845b6bf878+16:10398:x1871452228829184:12345-192.168.202.41@tcp:101:rm.0 00010000:00010000:2.0:1784756133.161965:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756133.161986:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891350391a00/0xc0f560bd53f9238 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9935e598575aca4 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756133.162056:0:5776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891350391400/0xc0f560bd53f923f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756133.162073:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891350391400/0xc0f560bd53f923f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756133.162084:0:5776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891350391400/0xc0f560bd53f923f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756133.162101:0:5776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891350390400/0xc0f560bd53f9246 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756133.162107:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891350390400/0xc0f560bd53f9246 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756133.162113:0:5776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891350390400/0xc0f560bd53f9246 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756133.162289:0:5776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891350391200/0xc0f560bd53f924d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756133.162298:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891350391200/0xc0f560bd53f924d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756133.162305:0:5776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891350391200/0xc0f560bd53f924d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784756133.162332:0:5776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1784756133.162336:0:5776:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784756133.162356:0:5776:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891350391200/0xc0f560bd53f924d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756133.162367:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891350391200/0xc0f560bd53f924d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756133.162374:0:5776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891350391400/0xc0f560bd53f923f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756133.162381:0:5776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891350391400/0xc0f560bd53f923f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756133.162386:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891350391400/0xc0f560bd53f923f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756133.162392:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891350391400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784756133.162396:0:5776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891350391400/0xc0f560bd53f923f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756133.162403:0:5776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891350391400/0xc0f560bd53f923f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756133.162449:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff891343cfd800) 00010000:00010000:2.0:1784756133.162453:0:5776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784756133.162458:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891350391400/0xc0f560bd53f923f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756133.162464:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891350391400/0xc0f560bd53f923f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756133.162478:0:5776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891350390400/0xc0f560bd53f9246 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756133.162484:0:5776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891350390400/0xc0f560bd53f9246 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756133.162489:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891350390400/0xc0f560bd53f9246 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756133.162494:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891350390400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784756133.162496:0:5776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891350390400/0xc0f560bd53f9246 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756133.162502:0:5776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891350390400/0xc0f560bd53f9246 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756133.162508:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x54725cf5 (ffff891351091600) 00010000:00010000:2.0:1784756133.162510:0:5776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784756133.162513:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891350390400/0xc0f560bd53f9246 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756133.162518:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891350390400/0xc0f560bd53f9246 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756133.162555:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891350391a00/0xc0f560bd53f9238 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575aca4 expref: 18 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756133.162566:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891350391200/0xc0f560bd53f924d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575aca4 expref: 17 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756133.162573:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff891343cfd700) 00010000:00010000:2.0:1784756133.162575:0:5776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784756133.162578:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891350391200, rc 0) 00000100:00100000:2.0:1784756133.163057:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:391dd9f2-6bf0-4674-aedd-25845b6bf878+17:10398:x1871452228829184:12345-192.168.202.41@tcp:101:rm.0 Request processed in 1112us (1311us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756133.163066:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 28 00000100:00100000:3.0:1784756133.167397:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1784756133.167635:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228829440 00000100:00100000:1.0:1784756133.167647:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228829440 00000100:00100000:1.0:1784756133.167709:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 29 00000100:00100000:1.0:1784756133.167720:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891375ee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:391dd9f2-6bf0-4674-aedd-25845b6bf878+17:10398:x1871452228829440:12345-192.168.202.41@tcp:36:rm.0 00010000:00010000:1.0:1784756133.167776:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1784756133.167804:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891350391200/0xc0f560bd53f924d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575aca4 expref: 17 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.167826:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59a00/0xc0f560bd53f91f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac88 expref: 16 pid: 8296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.167835:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff891343cfd700) 00010000:00010000:1.0:1784756133.167862:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59e00/0xc0f560bd53f920e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac8f expref: 15 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.167871:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff891343cfd800) 00010000:00010000:1.0:1784756133.167897:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784756133.167918:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59400/0xc0f560bd53f9254 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.167932:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59400/0xc0f560bd53f9254 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.167941:0:5775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59400/0xc0f560bd53f9254 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.167954:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59c00/0xc0f560bd53f925b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.167960:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59c00/0xc0f560bd53f925b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.167966:0:5775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59c00/0xc0f560bd53f925b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.168079:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58800/0xc0f560bd53f9262 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.168087:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58800/0xc0f560bd53f9262 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.168094:0:5775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58800/0xc0f560bd53f9262 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784756133.170060:0:5775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1784756133.170076:0:5775:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 250846660361ns, next at 251846656672ns, rc = 0 00010000:00010000:1.0:1784756133.170148:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59000/0xc0f560bd53f9269 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.170412:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59000/0xc0f560bd53f9269 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.170570:0:5775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59000/0xc0f560bd53f9269 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.170581:0:5775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59000/0xc0f560bd53f9269 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.170587:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59000/0xc0f560bd53f9269 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.170594:0:5775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59000/0xc0f560bd53f9269 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.170652:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784756133.170677:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58800/0xc0f560bd53f9262 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.170684:0:5775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58800/0xc0f560bd53f9262 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.170690:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58800/0xc0f560bd53f9262 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.170697:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89135fc58800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784756133.170701:0:5775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58800/0xc0f560bd53f9262 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.170709:0:5775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58800/0xc0f560bd53f9262 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.170732:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff891343cfd100) 00010000:00010000:1.0:1784756133.170735:0:5775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784756133.170740:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58800/0xc0f560bd53f9262 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.170747:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58800/0xc0f560bd53f9262 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.170769:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59400/0xc0f560bd53f9254 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.170775:0:5775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59400/0xc0f560bd53f9254 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.170782:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59400/0xc0f560bd53f9254 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.170787:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89135fc59400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784756133.170790:0:5775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59400/0xc0f560bd53f9254 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.170796:0:5775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59400/0xc0f560bd53f9254 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.170804:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff891343cfd800) 00010000:00010000:1.0:1784756133.170806:0:5775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784756133.170809:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59400/0xc0f560bd53f9254 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756133.170815:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59400/0xc0f560bd53f9254 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784756133.170838:0:5775:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000004bc0df4 reply state 00000000f6c4a3fc transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59c00/0xc0f560bd53f925b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756133.170859:0:5775:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784756133.170979:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891375ee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:391dd9f2-6bf0-4674-aedd-25845b6bf878+16:10398:x1871452228829440:12345-192.168.202.41@tcp:36:rm.0 Request processed in 3256us (3587us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1784756133.170989:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 29 00010000:00010000:2.0:1784756133.174818:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59c00/0xc0f560bd53f925b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756133.174837:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59c00/0xc0f560bd53f925b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756133.174845:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59c00/0xc0f560bd53f925b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756133.174862:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89135fc59c00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784756133.174867:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59c00/0xc0f560bd53f925b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756133.174874:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59c00/0xc0f560bd53f925b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756133.174901:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x54725cf5 (ffff891343cfdc00) 00010000:00010000:2.0:1784756133.174919:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784756133.174925:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59c00/0xc0f560bd53f925b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756133.174932:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59c00/0xc0f560bd53f925b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756133.176573:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00010000:00010000:0.0:1784756133.177178:0:5763:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784756133.177188:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59000/0xc0f560bd53f9269 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.177208:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89135fc59000 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:0.0:1784756133.177213:0:5763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59000/0xc0f560bd53f9269 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.177222:0:5763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59000/0xc0f560bd53f9269 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.177245:0:5763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff891343cfd100) 00010000:00010000:0.0:1784756133.177248:0:5763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784756133.177253:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59000/0xc0f560bd53f9269 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.177260:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59000/0xc0f560bd53f9269 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.177284:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756133.177286:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756133.177287:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756133.177683:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228829696 00000100:00100000:2.0:1784756133.177695:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228829696 00000100:00100000:2.0:1784756133.177785:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 5 00000100:00100000:2.0:1784756133.177796:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891374d66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:391dd9f2-6bf0-4674-aedd-25845b6bf878+15:10398:x1871452228829696:12345-192.168.202.41@tcp:35:rm.0 00000100:00100000:2.0:1784756133.178107:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891374d66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:391dd9f2-6bf0-4674-aedd-25845b6bf878+16:10398:x1871452228829696:12345-192.168.202.41@tcp:35:rm.0 Request processed in 311us (1883us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1784756133.178115:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 5 00000100:00100000:3.0:1784756133.180474:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1784756133.180634:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228829952 00000100:00100000:0.0:1784756133.180644:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228829952 00000100:00100000:0.0:1784756133.180695:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 30 00000100:00100000:0.0:1784756133.180705:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891374d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:391dd9f2-6bf0-4674-aedd-25845b6bf878+16:10398:x1871452228829952:12345-192.168.202.41@tcp:36:rm.0 00010000:00010000:0.0:1784756133.180767:0:6599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1784756133.180795:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58600/0xc0f560bd53f922a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac9d expref: 16 pid: 8296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.180816:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58a00/0xc0f560bd53f91c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac7a expref: 15 pid: 8296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.180842:0:6599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff891343cfd800) 00010000:00010000:0.0:1784756133.180874:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891350391800/0xc0f560bd53f9189 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575ac6c expref: 14 pid: 8296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.180883:0:6599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891351091700) 00010000:00010000:0.0:1784756133.180899:0:6599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784756133.180923:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891342bae600/0xc0f560bd53f9270 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.180936:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891342bae600/0xc0f560bd53f9270 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.180945:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891342bae600/0xc0f560bd53f9270 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.180959:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff891342baee00/0xc0f560bd53f9277 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.180965:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891342baee00/0xc0f560bd53f9277 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.180971:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891342baee00/0xc0f560bd53f9277 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.181312:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891342baf400/0xc0f560bd53f927e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.181322:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891342baf400/0xc0f560bd53f927e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.181339:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891342baf400/0xc0f560bd53f927e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784756133.182005:0:6599:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1784756133.182023:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff891342baf400/0xc0f560bd53f927e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.182031:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891342baf400/0xc0f560bd53f927e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.182038:0:6599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891342baf400/0xc0f560bd53f927e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.182044:0:6599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891342baf400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784756133.182048:0:6599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891342baf400/0xc0f560bd53f927e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.182055:0:6599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891342baf400/0xc0f560bd53f927e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.182065:0:6599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff89134803de00) 00010000:00010000:0.0:1784756133.182068:0:6599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784756133.182071:0:6599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891342baf400/0xc0f560bd53f927e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.182078:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891342baf400/0xc0f560bd53f927e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.182100:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff891342bae600/0xc0f560bd53f9270 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.182106:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891342bae600/0xc0f560bd53f9270 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.182118:0:6599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891342bae600/0xc0f560bd53f9270 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.182123:0:6599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891342bae600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784756133.182126:0:6599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891342bae600/0xc0f560bd53f9270 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.182131:0:6599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891342bae600/0xc0f560bd53f9270 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.182138:0:6599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89134803d900) 00010000:00010000:0.0:1784756133.182141:0:6599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784756133.182143:0:6599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891342bae600/0xc0f560bd53f9270 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756133.182148:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891342bae600/0xc0f560bd53f9270 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784756133.182161:0:6599:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f32738c5 reply state 0000000057d35c6d transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff891342baee00/0xc0f560bd53f9277 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756133.182170:0:6599:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784756133.182261:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891374d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:391dd9f2-6bf0-4674-aedd-25845b6bf878+15:10398:x1871452228829952:12345-192.168.202.41@tcp:36:rm.0 Request processed in 1555us (1793us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1784756133.182270:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 30 00010000:00010000:3.0:1784756133.184487:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff891342baee00/0xc0f560bd53f9277 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756133.184504:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891342baee00/0xc0f560bd53f9277 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756133.184512:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891342baee00/0xc0f560bd53f9277 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756133.184518:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891342baee00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784756133.184523:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891342baee00/0xc0f560bd53f9277 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756133.184529:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891342baee00/0xc0f560bd53f9277 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756133.184544:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff89134803df00) 00010000:00010000:3.0:1784756133.184547:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784756133.184551:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891342baee00/0xc0f560bd53f9277 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756133.184557:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891342baee00/0xc0f560bd53f9277 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756133.239122:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756134.198345:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136bd8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3291:1871452237254784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784756134.198448:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756134.198554:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237254784 00000100:00100000:2.0:1784756134.198562:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237254784 00000100:00100000:2.0:1784756134.198615:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784756134.198624:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136bd89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1871452237254784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784756134.198680:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756134.198738:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136bd89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1871452237254784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756134.198745:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1784756134.198789:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136bd8a680 x1871452237254784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756150 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756134.198806:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136bd8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3291:1871452237254784:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784756134.199169:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784756134.260131:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756135.284283:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756136.308439:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1784756136.756214:0:7905:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 254432795628ns, next at 255432793748ns, rc = 0 00000100:00100000:2.0:1784756136.757348:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3290:1871452237255168:0@lo:400:kworker.0 00000100:00100000:2.0:1784756136.757454:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756136.757512:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136fa58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237255680:0@lo:400:kworker.0 00000100:00100000:2.0:1784756136.757536:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756136.757571:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784756136.757577:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136fa5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3290:1871452237255296:0@lo:400:kworker.0 00000100:00100000:2.0:1784756136.757601:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756136.757635:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237255680 00000100:00100000:2.0:1784756136.757642:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237255680 00000100:00100000:2.0:1784756136.757699:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784756136.757801:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237255168 00000100:00100000:3.0:1784756136.757806:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237255168 00000100:00100000:3.0:1784756136.757842:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237255296 00000100:00100000:3.0:1784756136.757870:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237255296 00000100:00100000:3.0:1784756136.757894:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1784756136.757900:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136bd8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1871452237255168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756136.757962:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136bd8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1871452237255168:12345-0@lo:400:kworker.0 Request processed in 62us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756136.757968:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1784756136.757986:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1784756136.757993:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136bd89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1871452237255296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756136.758046:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136bd89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1871452237255296:12345-0@lo:400:kworker.0 Request processed in 54us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756136.758052:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1784756136.758088:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136fa5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3290:1871452237255296:0@lo:400:kworker.0 00000100:00100000:3.0:1784756136.758098:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3290:1871452237255168:0@lo:400:kworker.0 00000100:00100000:2.0:1784756136.758347:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136bd88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3290:x1871452237255680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756136.758393:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136bd88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3290:x1871452237255680:12345-0@lo:400:kworker.0 Request processed in 686us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756136.758400:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1784756136.758587:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136fa58700 x1871452237255680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756136.758599:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136fa58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237255680:0@lo:400:kworker.0 00000100:00100000:1.0:1784756136.758670:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136bd8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237254912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784756136.758726:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756136.758755:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136fa58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237255424:0@lo:400:kworker.0 00000100:00100000:1.0:1784756136.759096:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756136.759132:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784756136.759139:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff891353e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a5739ad-a70a-4582-8756-59cdd498af45:3292:1871452237255040:0@lo:400:kworker.0 00000100:00100000:1.0:1784756136.759161:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756136.759183:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136fa5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3292:1871452237255552:0@lo:400:kworker.0 00000100:00100000:1.0:1784756136.759201:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756136.759227:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237255040 00000100:00100000:1.0:1784756136.759231:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237255040 00000100:00100000:1.0:1784756136.759260:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1784756136.759266:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+19:3292:x1871452237255040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756136.759298:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+19:3292:x1871452237255040:12345-0@lo:400:kworker.0 Request processed in 31us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756136.759317:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1784756136.759353:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff891353e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a5739ad-a70a-4582-8756-59cdd498af45:3292:1871452237255040:0@lo:400:kworker.0 00000100:00100000:1.0:1784756136.759380:0:8296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237255552 00000100:00100000:1.0:1784756136.759383:0:8296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237255552 00000100:00100000:1.0:1784756136.759408:0:8296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1784756136.759439:0:8296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1871452237255552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756136.759472:0:8296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1871452237255552:12345-0@lo:400:kworker.0 Request processed in 59us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756136.759478:0:8296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1784756136.759498:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136fa5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3292:1871452237255552:0@lo:400:kworker.0 00000100:00100000:3.0:1784756136.760246:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237255424 00000100:00100000:3.0:1784756136.760252:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237255424 00000100:00100000:3.0:1784756136.760302:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784756136.760309:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8913759e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237255424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756136.760355:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8913759e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237255424:12345-0@lo:400:kworker.0 Request processed in 47us (1259us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756136.760360:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1784756136.761923:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784756136.761934:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784756136.761937:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784756136.762183:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237254912 00000100:00100000:2.0:1784756136.762193:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237254912 00000100:00100000:2.0:1784756136.762261:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784756136.762272:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f83b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237254912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784756136.762308:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756136.762380:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f83b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237254912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (3652us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756136.762387:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1784756136.764216:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136bd8a680 x1871452237254912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756152 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756136.764240:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136bd8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237254912:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1784756136.764252:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136fa58380 x1871452237255424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756136.764260:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136fa58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237255424:0@lo:400:kworker.0 00010000:00010000:1.0:1784756137.331703:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756137.500543:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1784756137.500603:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1784756137.500651:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1784756137.500731:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228830336 00000100:00100000:0.0:1784756137.500742:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228830336 00000100:00100000:1.0:1784756137.500817:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228830080 00000100:00100000:1.0:1784756137.500823:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228830080 00000100:00100000:1.0:1784756137.500877:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 236 00000100:00100000:1.0:1784756137.500888:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+10:2353:x1871452228830080:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1784756137.500971:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+10:2353:x1871452228830080:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 84us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756137.500979:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 43 00000100:00100000:1.0:1784756137.500984:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 236 00000100:00100000:0.0:1784756137.500992:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136fa5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:391dd9f2-6bf0-4674-aedd-25845b6bf878+5:2353:x1871452228830336:12345-192.168.202.41@tcp:400:kworker.0 00000100:00080000:1.0:1784756137.501033:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784756137.501033:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136fa5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:391dd9f2-6bf0-4674-aedd-25845b6bf878+5:2353:x1871452228830336:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 44us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756137.501044:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 43 00000100:00100000:2.0:1784756137.501442:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228830208 00000100:00100000:2.0:1784756137.501449:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228830208 00000100:00100000:2.0:1784756137.501503:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 99 00000100:00100000:2.0:1784756137.501518:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136fa59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:391dd9f2-6bf0-4674-aedd-25845b6bf878+14:2353:x1871452228830208:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1784756137.501572:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136fa59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:391dd9f2-6bf0-4674-aedd-25845b6bf878+14:2353:x1871452228830208:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 54us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756137.501579:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 99 00000100:00080000:1.0:1784756137.501789:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1784756138.349592:0:5796:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:1.0:1784756138.349613:0:5796:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000004:00080000:1.0:1784756138.349626:0:5796:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:3.0:1784756138.350430:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136f838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3291:1871452237255808:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1784756138.350502:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756138.350641:0:9140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237255808 00000100:00100000:0.0:1784756138.350658:0:9140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237255808 00000100:00100000:0.0:1784756138.350723:0:9140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784756138.350733:0:9140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136fa5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3291:x1871452237255808:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1784756138.350760:0:9140:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1784756138.350794:0:9140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a6137a5, atime: 0x6a6137a5, ctime: 0x6a6137a5, blocks: 0x1 00010000:00010000:0.0:1784756138.350811:0:9140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000491b9ab9/0xc0f560bd53f9285 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756138.350828:0:9140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=256s v=(0 0) 00010000:00010000:0.0:1784756138.350833:0:9140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784756138.350840:0:9140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000491b9ab9/0xc0f560bd53f9285 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756138.350857:0:9140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000491b9ab9/0xc0f560bd53f9285 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756138.350869:0:9140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000491b9ab9/0xc0f560bd53f9285 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756138.350897:0:9140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000491b9ab9/0xc0f560bd53f9285 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756138.351033:0:9140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:3.0:1784756138.351315:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784756138.352972:0:9140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136fa5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3291:x1871452237255808:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2234us (2463us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1784756138.352984:0:9140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1784756138.353020:0:5763:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784756138.353027:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000491b9ab9/0xc0f560bd53f9285 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756138.353039:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891342baf400 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:0.0:1784756138.353043:0:5763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000491b9ab9/0xc0f560bd53f9285 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756138.353053:0:5763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000491b9ab9/0xc0f560bd53f9285 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756138.353072:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000491b9ab9/0xc0f560bd53f9285 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756138.353079:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000491b9ab9/0xc0f560bd53f9285 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756138.353109:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756138.353120:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756138.353121:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1784756138.353679:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89136f838e00/2, rc 0, transno 4294967300 00000100:00100000:3.0:1784756138.353688:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136f838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3291:1871452237255808:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1784756138.359329:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756138.941879:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1784756138.943056:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228830464 00000100:00100000:1.0:1784756138.943067:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228830464 00000100:00100000:1.0:1784756138.943143:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 31 00000100:00100000:1.0:1784756138.943164:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136fa59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+5:10908:x1871452228830464:12345-192.168.202.41@tcp:101:rm.0 00010000:00010000:1.0:1784756138.943192:0:5774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784756138.943211:0:5774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58800/0xc0f560bd53f928c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9935e598575acab expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756138.943267:0:5774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59e00/0xc0f560bd53f9293 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756138.943278:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59e00/0xc0f560bd53f9293 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756138.943288:0:5774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59e00/0xc0f560bd53f9293 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784756138.943659:0:5774:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1784756138.943663:0:5774:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1784756138.943730:0:5774:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59e00/0xc0f560bd53f9293 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756138.943755:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58800/0xc0f560bd53f928c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575acab expref: 7 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756138.943773:0:5774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59e00/0xc0f560bd53f9293 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575acab expref: 6 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756138.943794:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891343cfd700) 00010000:00010000:1.0:1784756138.943807:0:5774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784756138.943811:0:5774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89135fc59e00, rc 0) 00000100:00100000:1.0:1784756138.943885:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136fa59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:10908:x1871452228830464:12345-192.168.202.41@tcp:101:rm.0 Request processed in 723us (2015us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756138.943892:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 31 00000100:00100000:0.0:1784756138.951493:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1784756138.951561:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228830592 00000100:00100000:2.0:1784756138.951570:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228830592 00000100:00100000:2.0:1784756138.951624:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 32 00000100:00100000:2.0:1784756138.951633:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136fa48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:10908:x1871452228830592:12345-192.168.202.41@tcp:101:rm.0 00010000:00010000:2.0:1784756138.951652:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756138.951671:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891350391a00/0xc0f560bd53f929a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9935e598575acb2 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756138.951739:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891350390400/0xc0f560bd53f92a1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756138.951754:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891350390400/0xc0f560bd53f92a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756138.951765:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891350390400/0xc0f560bd53f92a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756138.951810:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891350391400/0xc0f560bd53f92a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756138.951818:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891350391400/0xc0f560bd53f92a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756138.951825:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891350391400/0xc0f560bd53f92a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756138.952067:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891350390400/0xc0f560bd53f92a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756138.952075:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891350390400/0xc0f560bd53f92a1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756138.952080:0:6599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891350390400/0xc0f560bd53f92a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756138.952085:0:6599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891350390400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784756138.952089:0:6599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891350390400/0xc0f560bd53f92a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756138.952097:0:6599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891350390400/0xc0f560bd53f92a1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756138.952108:0:6599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891343cfd700) 00010000:00010000:2.0:1784756138.952111:0:6599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784756138.952115:0:6599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891350390400/0xc0f560bd53f92a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756138.952120:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891350390400/0xc0f560bd53f92a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756138.952129:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891350391400/0xc0f560bd53f92a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756138.952134:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff891350391400/0xc0f560bd53f92a8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756138.952139:0:6599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff891350391400/0xc0f560bd53f92a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756138.952148:0:6599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891350391400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784756138.952151:0:6599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891350391400/0xc0f560bd53f92a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756138.952156:0:6599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff891350391400/0xc0f560bd53f92a8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756138.952162:0:6599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfd1ea4b6 (ffff891351091c00) 00010000:00010000:2.0:1784756138.952164:0:6599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784756138.952166:0:6599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff891350391400/0xc0f560bd53f92a8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756138.952171:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891350391400/0xc0f560bd53f92a8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756138.952197:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891350391a00/0xc0f560bd53f929a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575acb2 expref: 7 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756138.952206:0:6599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891343cfd700) 00010000:00010000:2.0:1784756138.952207:0:6599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784756138.952210:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891350391a00/0xc0f560bd53f929a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575acb2 expref: 7 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756138.952217:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891350391a00, rc 0) 00000100:00100000:2.0:1784756138.952278:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136fa48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:10908:x1871452228830592:12345-192.168.202.41@tcp:101:rm.0 Request processed in 646us (794us total) trans 0 rc 301/301 00000100:00100000:2.0:1784756138.952284:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 32 00000100:00100000:3.0:1784756139.316977:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784756139.317002:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136fa58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1871452237255936:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784756139.317071:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756139.317152:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237255936 00000100:00100000:3.0:1784756139.317160:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237255936 00000100:00080000:1.0:1784756139.317198:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784756139.317217:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1784756139.317238:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136fa5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1871452237255936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784756139.317270:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784756139.317324:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136fa5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1871452237255936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756139.317331:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1784756139.319055:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136fa58700 x1871452237255936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756155 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756139.319082:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136fa58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1871452237255936:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784756139.379771:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756140.403971:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756141.427674:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784756141.771875:0:11687:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 119l: test nohybrid flag prevents hybrid IO switching ========================================================== 17:35:40 (1784756140) 00000100:00100000:2.0:1784756141.878882:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136bd89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3290:1871452237256192:0@lo:400:kworker.0 00000100:00100000:2.0:1784756141.878994:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756141.879354:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136bd88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237256704:0@lo:400:kworker.0 00000100:00100000:2.0:1784756141.879385:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756141.879446:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784756141.879453:0:3290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136bd8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3290:1871452237256320:0@lo:400:kworker.0 00000100:00100000:2.0:1784756141.879477:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756141.879519:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237256192 00000100:00100000:2.0:1784756141.879526:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237256192 00000100:00100000:2.0:1784756141.879573:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237256320 00000100:00100000:2.0:1784756141.879576:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237256320 00000100:00100000:2.0:1784756141.879604:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1784756141.879613:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f469c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1871452237256192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756141.879862:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f469c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1871452237256192:12345-0@lo:400:kworker.0 Request processed in 249us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756141.879870:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1784756141.879888:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1784756141.879895:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1871452237256320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756141.879924:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1871452237256320:12345-0@lo:400:kworker.0 Request processed in 29us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756141.879929:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1784756141.879973:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136bd8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3290:1871452237256320:0@lo:400:kworker.0 00000100:00100000:2.0:1784756141.879984:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136bd89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3290:1871452237256192:0@lo:400:kworker.0 00000100:00080000:2.0:1784756141.881427:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784756141.881457:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136bd8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3a5739ad-a70a-4582-8756-59cdd498af45:3293:1871452237256064:0@lo:400:kworker.0 00000100:00100000:2.0:1784756141.881514:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756141.881566:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136bd88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3293:1871452237256576:0@lo:400:kworker.0 00000100:00100000:2.0:1784756141.881594:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756141.881621:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784756141.881627:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136bd89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1871452237256448:0@lo:400:kworker.0 00000100:00100000:2.0:1784756141.881653:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756141.881687:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237256576 00000100:00100000:2.0:1784756141.881694:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237256576 00000100:00100000:2.0:1784756141.881742:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1784756141.881752:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f46a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1871452237256576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756141.882919:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f46a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1871452237256576:12345-0@lo:400:kworker.0 Request processed in 1164us (1319us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756141.882931:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1784756141.882968:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237256704 00000100:00100000:2.0:1784756141.882973:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237256704 00000100:00100000:2.0:1784756141.883007:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237256448 00000100:00100000:2.0:1784756141.883010:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237256448 00000100:00100000:2.0:1784756141.883032:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784756141.883039:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f468a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3290:x1871452237256704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756141.883204:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f468a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3290:x1871452237256704:12345-0@lo:400:kworker.0 Request processed in 164us (3816us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756141.883210:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784756141.883223:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784756141.883229:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f46bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1871452237256448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756141.883257:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f46bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1871452237256448:12345-0@lo:400:kworker.0 Request processed in 29us (1603us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756141.883263:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1784756141.883279:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784756141.883294:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784756141.883297:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1784756141.883333:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89136bd89500 x1871452237256448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756141.883349:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136bd89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1871452237256448:0@lo:400:kworker.0 00000100:00100000:2.0:1784756141.883361:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136bd88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3293:1871452237256576:0@lo:400:kworker.0 00000100:00100000:2.0:1784756141.883401:0:3290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136bd88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1871452237256704:0@lo:400:kworker.0 00000100:00100000:0.0:1784756141.885489:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237256064 00000100:00100000:0.0:1784756141.885508:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237256064 00000100:00100000:0.0:1784756141.885589:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1784756141.885601:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+19:3293:x1871452237256064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756141.885693:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a5739ad-a70a-4582-8756-59cdd498af45+19:3293:x1871452237256064:12345-0@lo:400:kworker.0 Request processed in 95us (4178us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756141.885701:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1784756141.885766:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136bd8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3a5739ad-a70a-4582-8756-59cdd498af45:3293:1871452237256064:0@lo:400:kworker.0 00000100:00100000:3.0:1784756141.891955:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136f46b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3291:1871452237256832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784756141.892045:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756141.892591:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237256832 00000100:00100000:2.0:1784756141.892600:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237256832 00000100:00100000:2.0:1784756141.892659:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1784756141.892668:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136fa58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3291:x1871452237256832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784756141.892708:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756141.892763:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136fa58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3291:x1871452237256832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756141.892782:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784756141.892872:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136f46b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3291:1871452237256832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784756142.001320:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1784756142.001360:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228830848 00000100:00100000:1.0:1784756142.001370:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228830848 00000100:00100000:1.0:1784756142.001882:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 33 00000100:00100000:1.0:1784756142.001893:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f83b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:11148:x1871452228830848:12345-192.168.202.41@tcp:101:dd.0 00010000:00010000:1.0:1784756142.001916:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784756142.001919:0:6599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1784756142.001950:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59e00/0xc0f560bd53f9293 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575acab expref: 6 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756142.001970:0:6599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891343cfd700) 00010000:00010000:1.0:1784756142.001983:0:6599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784756142.002008:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58c00/0xc0f560bd53f92af lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9935e598575acb9 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784756142.003591:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784756142.005305:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59800/0xc0f560bd53f92b6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756142.005329:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59800/0xc0f560bd53f92b6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756142.005343:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59800/0xc0f560bd53f92b6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756142.005358:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58200/0xc0f560bd53f92bd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6a35613e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756142.005364:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58200/0xc0f560bd53f92bd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756142.005370:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58200/0xc0f560bd53f92bd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784756142.009236:0:6599:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1784756142.009607:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58000/0xc0f560bd53f92c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756142.011887:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58000/0xc0f560bd53f92c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756142.011914:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58000/0xc0f560bd53f92c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756142.011982:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59800/0xc0f560bd53f92b6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756142.011999:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59800/0xc0f560bd53f92b6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756142.012005:0:6599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59800/0xc0f560bd53f92b6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756142.012011:0:6599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89135fc59800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784756142.012016:0:6599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59800/0xc0f560bd53f92b6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756142.012023:0:6599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59800/0xc0f560bd53f92b6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756142.012037:0:6599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891343cfd900) 00010000:00010000:1.0:1784756142.012040:0:6599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784756142.012044:0:6599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59800/0xc0f560bd53f92b6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756142.012050:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc59800/0xc0f560bd53f92b6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784756142.012063:0:6599:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fa8ae6f9 reply state 00000000ae259f2c transno 4294967309 ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58200/0xc0f560bd53f92bd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756142.012071:0:6599:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784756142.012115:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58c00/0xc0f560bd53f92af lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575acb9 expref: 8 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756142.012140:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58000/0xc0f560bd53f92c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575acb9 expref: 7 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756142.012158:0:6599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff891343cfd000) 00010000:00010000:1.0:1784756142.012161:0:6599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784756142.012164:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89135fc58000, rc 0) 00000100:00100000:1.0:1784756142.012478:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f83b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:391dd9f2-6bf0-4674-aedd-25845b6bf878+8:11148:x1871452228830848:12345-192.168.202.41@tcp:101:dd.0 Request processed in 10585us (11165us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1784756142.012487:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 33 00010000:00010000:3.0:1784756142.030937:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58200/0xc0f560bd53f92bd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756142.030953:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58200/0xc0f560bd53f92bd lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756142.030973:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58200/0xc0f560bd53f92bd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756142.030979:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89135fc58200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784756142.030983:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58200/0xc0f560bd53f92bd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756142.030990:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58200/0xc0f560bd53f92bd lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756142.031006:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6a35613e (ffff891343cfd300) 00010000:00010000:3.0:1784756142.031009:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784756142.031013:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58200/0xc0f560bd53f92bd lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756142.031019:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58200/0xc0f560bd53f92bd lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756142.116094:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1784756142.116278:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228830976 00000100:00100000:2.0:1784756142.116288:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228830976 00000100:00100000:2.0:1784756142.116388:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 15 00000100:00100000:2.0:1784756142.116396:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f838380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1871452228830976:12345-192.168.202.41@tcp:8:kworker.0 00010000:00080000:2.0:1784756142.116467:0:6578:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 391dd9f2-6bf0-4674-aedd-25845b6bf878@192.168.202.41@tcp t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:2.0:1784756142.116498:0:6578:0:(genops.c:1406:class_connect()) connect: client 391dd9f2-6bf0-4674-aedd-25845b6bf878, cookie 0xc0f560bd53f92d2 00002000:00100000:2.0:1784756142.116511:0:6578:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 391dd9f2-6bf0-4674-aedd-25845b6bf878/ffff891375e54000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136b7 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784756142.116536:0:6578:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type 37, return 37 00002000:00080000:2.0:1784756142.116813:0:6578:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784756142.116856:0:6578:0:(import.c:65:import_set_state_nolock()) ffff891375e50000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784756142.116933:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f838380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2350:x1871452228830976:12345-192.168.202.41@tcp:8:kworker.0 Request processed in 535us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756142.116941:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 15 00000100:00100000:1.0:1784756142.121581:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1784756142.121833:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228831104 00000100:00100000:3.0:1784756142.121843:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228831104 00000100:00100000:3.0:1784756142.121936:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 0 00000100:00100000:3.0:1784756142.121946:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136ce53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2351:x1871452228831104:12345-192.168.202.41@tcp:4:dd.0 00002000:00010000:3.0:1784756142.121993:0:6581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784756142.122002:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015a9160d/0xc0f560bd53f92d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756142.122019:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=259s v=(0 0) 00010000:00010000:3.0:1784756142.122023:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784756142.122044:0:6581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015a9160d/0xc0f560bd53f92d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756142.122060:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015a9160d/0xc0f560bd53f92d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784756142.122315:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784756142.127615:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1784756142.127753:0:6583:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1784756142.127765:0:6583:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1784756142.128001:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228831232 00000100:00100000:2.0:1784756142.128013:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228831232 00000100:00100000:0.0:1784756142.130306:0:11699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 1 00000100:00100000:0.0:1784756142.130324:0:11699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136ce52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:391dd9f2-6bf0-4674-aedd-25845b6bf878+8:2352:x1871452228831232:12345-192.168.202.41@tcp:4:dd.0 00010000:00010000:0.0:1784756142.130365:0:11699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6509a5e/0xc0f560bd53f92e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.130385:0:11699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784756142.130389:0:11699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784756142.130395:0:11699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6509a5e/0xc0f560bd53f92e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.130410:0:11699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6509a5e/0xc0f560bd53f92e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1784756142.195063:0:6601:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 391dd9f2-6bf0-4674-aedd-25845b6bf878 00000001:00080000:2.0:1784756142.235088:0:6601:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00002000:00010000:3.0:1784756142.238026:0:6581:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:3.0:1784756142.238037:0:6581:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1784756142 00002000:00010000:3.0:1784756142.238039:0:6581:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1784756142 00002000:00010000:3.0:1784756142.238041:0:6581:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:3.0:1784756142.238058:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015a9160d/0xc0f560bd53f92d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756142.238183:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015a9160d/0xc0f560bd53f92d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756142.238193:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015a9160d/0xc0f560bd53f92d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756142.238200:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89134151a600 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:3.0:1784756142.238205:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015a9160d/0xc0f560bd53f92d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756142.238214:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015a9160d/0xc0f560bd53f92d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756142.238237:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015a9160d/0xc0f560bd53f92d9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756142.238258:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015a9160d/0xc0f560bd53f92d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756142.238378:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136ce53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+9:2351:x1871452228831104:12345-192.168.202.41@tcp:4:dd.0 Request processed in 116427us (116803us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1784756142.238390:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 0 00000001:00080000:3.0:1784756142.320461:0:6601:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:2.0:1784756142.320600:0:11699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6509a5e/0xc0f560bd53f92e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756142.320614:0:11699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6509a5e/0xc0f560bd53f92e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756142.320624:0:11699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6509a5e/0xc0f560bd53f92e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756142.320631:0:11699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891342baee00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:2.0:1784756142.320637:0:11699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6509a5e/0xc0f560bd53f92e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756142.320646:0:11699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6509a5e/0xc0f560bd53f92e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756142.320670:0:11699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6509a5e/0xc0f560bd53f92e0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756142.320678:0:11699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6509a5e/0xc0f560bd53f92e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756142.320853:0:11699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136ce52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:391dd9f2-6bf0-4674-aedd-25845b6bf878+5:2352:x1871452228831232:12345-192.168.202.41@tcp:4:dd.0 Request processed in 190527us (193241us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1784756142.320864:0:11699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 1 00000100:00100000:3.0:1784756142.337708:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1784756142.338341:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228831488 00000100:00100000:2.0:1784756142.338355:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228831488 00000100:00100000:2.0:1784756142.338529:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 6 00000100:00100000:2.0:1784756142.338540:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136fa58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:391dd9f2-6bf0-4674-aedd-25845b6bf878+7:11148:x1871452228831488:12345-192.168.202.41@tcp:35:dd.0 00000100:00100000:2.0:1784756142.338924:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136fa58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:391dd9f2-6bf0-4674-aedd-25845b6bf878+8:11148:x1871452228831488:12345-192.168.202.41@tcp:35:dd.0 Request processed in 385us (1226us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1784756142.338932:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 6 00000100:00100000:0.0:1784756142.412312:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1784756142.412486:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228831616 00000100:00100000:2.0:1784756142.412497:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228831616 00000100:00100000:2.0:1784756142.412567:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 34 00000100:00100000:2.0:1784756142.412578:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136fa49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:391dd9f2-6bf0-4674-aedd-25845b6bf878+8:11155:x1871452228831616:12345-192.168.202.41@tcp:101:dd.0 00010000:00010000:2.0:1784756142.412605:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756142.412634:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891350390400/0xc0f560bd53f92e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9935e598575acc0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756142.412710:0:5776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff891350390600/0xc0f560bd53f92ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756142.412725:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891350390600/0xc0f560bd53f92ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756142.412739:0:5776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891350390600/0xc0f560bd53f92ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784756142.412830:0:5776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1784756142.412835:0:5776:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1784756142.412860:0:5776:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff891350390600/0xc0f560bd53f92ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756142.412886:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891350390400/0xc0f560bd53f92e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575acc0 expref: 10 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756142.412909:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891350390600/0xc0f560bd53f92ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575acc0 expref: 9 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756142.412918:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891351091600) 00010000:00010000:2.0:1784756142.412922:0:5776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784756142.412925:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891350390600, rc 0) 00000100:00100000:2.0:1784756142.412994:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136fa49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:391dd9f2-6bf0-4674-aedd-25845b6bf878+9:11155:x1871452228831616:12345-192.168.202.41@tcp:101:dd.0 Request processed in 418us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756142.413002:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 34 00000100:00100000:3.0:1784756142.418535:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1784756142.418684:0:8296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228831872 00000100:00100000:0.0:1784756142.418696:0:8296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228831872 00000100:00100000:0.0:1784756142.418762:0:8296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 35 00000100:00100000:0.0:1784756142.418781:0:8296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136fa58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:391dd9f2-6bf0-4674-aedd-25845b6bf878+9:11155:x1871452228831872:12345-192.168.202.41@tcp:101:dd.0 00010000:00010000:0.0:1784756142.418803:0:8296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756142.418825:0:8296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891342baea00/0xc0f560bd53f92f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9935e598575acc7 expref: -99 pid: 8296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.418928:0:8296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff891342baec00/0xc0f560bd53f92fc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.418944:0:8296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff891342baec00/0xc0f560bd53f92fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.418956:0:8296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff891342baec00/0xc0f560bd53f92fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784756142.418968:0:8296:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 2097152 00010000:00010000:0.0:1784756142.419271:0:8296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff891342baea00/0xc0f560bd53f92f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575acc7 expref: 12 pid: 8296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.419293:0:8296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff891342baec00/0xc0f560bd53f92fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575acc7 expref: 11 pid: 8296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.419303:0:8296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff891343cfd000) 00010000:00010000:0.0:1784756142.419307:0:8296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1784756142.419310:0:8296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891342baec00, rc 0) 00000100:00100000:0.0:1784756142.419378:0:8296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136fa58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:391dd9f2-6bf0-4674-aedd-25845b6bf878+11:11155:x1871452228831872:12345-192.168.202.41@tcp:101:dd.0 Request processed in 598us (857us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1784756142.419402:0:8296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 35 00000100:00100000:3.0:1784756142.424647:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1784756142.424774:0:9140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228832000 00000100:00100000:0.0:1784756142.424784:0:9140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228832000 00000100:00100000:0.0:1784756142.424834:0:9140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:0.0:1784756142.424843:0:9140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136fa58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:391dd9f2-6bf0-4674-aedd-25845b6bf878+5:2352:x1871452228832000:12345-192.168.202.41@tcp:101:dd.0 00010000:00010000:0.0:1784756142.424861:0:9140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756142.424882:0:9140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ecd658c/0xc0f560bd53f930a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf9935e598575acce expref: -99 pid: 9140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784756142.424909:0:9140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 2097152, mtime: 0x6a6137ae, atime: 0x0, ctime: 0x6a6137ae, blocks: 0x1007 00010000:00010000:0.0:1784756142.424928:0:9140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=260s v=(0 0) 00010000:00010000:0.0:1784756142.424933:0:9140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784756142.424943:0:9140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ecd658c/0xc0f560bd53f930a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575acce expref: 6 pid: 9140 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.424962:0:9140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009ecd658c/0xc0f560bd53f930a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575acce expref: 6 pid: 9140 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.424977:0:9140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff891342baea00, rc 0) 00000100:00100000:0.0:1784756142.425043:0:9140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136fa58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2352:x1871452228832000:12345-192.168.202.41@tcp:101:dd.0 Request processed in 200us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756142.425050:0:9140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 16 00010000:00010000:1.0:1784756142.452814:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756142.457985:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1784756142.458022:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1784756142.458110:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228832256 00000100:00100000:2.0:1784756142.458110:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228832128 00000100:00100000:2.0:1784756142.458121:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228832128 00000100:00100000:3.0:1784756142.458123:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228832256 00000100:00100000:3.0:1784756142.458193:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 2 00000100:00100000:3.0:1784756142.458204:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136ce51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:391dd9f2-6bf0-4674-aedd-25845b6bf878+7:2352:x1871452228832256:12345-192.168.202.41@tcp:3:dd.0 00000100:00100000:2.0:1784756142.458260:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 3 00000100:00100000:2.0:1784756142.458267:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136ce50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:391dd9f2-6bf0-4674-aedd-25845b6bf878+7:2352:x1871452228832128:12345-192.168.202.41@tcp:3:dd.0 00010000:00010000:3.0:1784756142.458274:0:6582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000015a9160d/0xc0f560bd53f9311 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756142.458283:0:6583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004da475de/0xc0f560bd53f9318 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756142.458299:0:6583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784756142.458304:0:6583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784756142.458310:0:6583:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004da475de/0xc0f560bd53f9318 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756142.458341:0:6583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004da475de/0xc0f560bd53f9318 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756142.471521:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784756142.471532:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784756142.471542:0:6582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015a9160d/0xc0f560bd53f9311 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756142.471563:0:6582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015a9160d/0xc0f560bd53f9311 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756142.505691:0:6583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004da475de/0xc0f560bd53f9318 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756142.505713:0:6583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004da475de/0xc0f560bd53f9318 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756142.505722:0:6583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004da475de/0xc0f560bd53f9318 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756142.505729:0:6583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff891350390400 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:2.0:1784756142.505734:0:6583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004da475de/0xc0f560bd53f9318 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756142.505743:0:6583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004da475de/0xc0f560bd53f9318 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756142.505772:0:6583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004da475de/0xc0f560bd53f9318 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756142.505780:0:6583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004da475de/0xc0f560bd53f9318 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756142.505866:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136ce50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:391dd9f2-6bf0-4674-aedd-25845b6bf878+8:2352:x1871452228832128:12345-192.168.202.41@tcp:3:dd.0 Request processed in 47593us (47837us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1784756142.505888:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 3 00010000:00010000:3.0:1784756142.518536:0:6582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000015a9160d/0xc0f560bd53f9311 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756142.518572:0:6582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015a9160d/0xc0f560bd53f9311 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756142.518583:0:6582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015a9160d/0xc0f560bd53f9311 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756142.518591:0:6582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89134151a600 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:3.0:1784756142.518596:0:6582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015a9160d/0xc0f560bd53f9311 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756142.518605:0:6582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015a9160d/0xc0f560bd53f9311 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756142.518624:0:6582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015a9160d/0xc0f560bd53f9311 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756142.518632:0:6582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015a9160d/0xc0f560bd53f9311 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756142.518724:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136ce51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2352:x1871452228832256:12345-192.168.202.41@tcp:3:dd.0 Request processed in 60517us (60743us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1784756142.518734:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 2 00000100:00100000:0.0:1784756142.620081:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1784756142.620184:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1784756142.620260:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228832384 00000100:00100000:1.0:1784756142.620271:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228832384 00000100:00100000:1.0:1784756142.620332:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 238 00000100:00100000:1.0:1784756142.620343:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff891347bf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+10:2353:x1871452228832384:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1784756142.620458:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff891347bf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e891795-8b87-4754-b411-3420f9834f05+10:2353:x1871452228832384:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 117us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756142.620466:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 238 00000100:00100000:2.0:1784756142.620673:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228832512 00000100:00100000:2.0:1784756142.620678:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228832512 00000100:00100000:2.0:1784756142.620733:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 46 00000100:00100000:2.0:1784756142.620740:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136fa4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:391dd9f2-6bf0-4674-aedd-25845b6bf878+5:2354:x1871452228832512:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1784756142.620786:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136fa4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:391dd9f2-6bf0-4674-aedd-25845b6bf878+5:2354:x1871452228832512:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 46us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756142.620792:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 46 00000100:00080000:1.0:1784756142.620795:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784756142.670327:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1784756142.670657:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228832768 00000100:00100000:1.0:1784756142.670667:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228832768 00000100:00100000:1.0:1784756142.670728:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 36 00000100:00100000:1.0:1784756142.670738:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:391dd9f2-6bf0-4674-aedd-25845b6bf878+11:11159:x1871452228832768:12345-192.168.202.41@tcp:36:lfs.0 00010000:00010000:1.0:1784756142.670810:0:6599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784756142.670849:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89135fc58000/0xc0f560bd53f92c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575acb9 expref: 11 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756142.670871:0:6599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff891343cfd000) 00010000:00010000:1.0:1784756142.670875:0:6599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784756142.670897:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89136c2ff200/0xc0f560bd53f931f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756142.670911:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89136c2ff200/0xc0f560bd53f931f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756142.670922:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89136c2ff200/0xc0f560bd53f931f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784756142.671100:0:6599:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bf35e706 reply state 000000001494af76 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff89136c2ff200/0xc0f560bd53f931f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756142.671109:0:6599:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784756142.671290:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:391dd9f2-6bf0-4674-aedd-25845b6bf878+12:11159:x1871452228832768:12345-192.168.202.41@tcp:36:lfs.0 Request processed in 552us (973us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1784756142.671298:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 36 00000100:00100000:0.0:1784756142.682934:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1784756142.683703:0:9140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228832896 00000100:00100000:1.0:1784756142.683715:0:9140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228832896 00000100:00100000:1.0:1784756142.683781:0:9140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 17 00000100:00100000:1.0:1784756142.683792:0:9140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136fa4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2353:x1871452228832896:12345-192.168.202.41@tcp:2:lfs.0 00002000:00010000:1.0:1784756142.684059:0:9140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1784756142.684063:0:9140:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 1784756142 -> 1784756142 00002000:00010000:1.0:1784756142.684077:0:9140:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1784756142.684080:0:9140:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 1784756142 -> 1784756142 00002000:00010000:1.0:1784756142.684082:0:9140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:1.0:1784756142.684167:0:9140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136fa4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:391dd9f2-6bf0-4674-aedd-25845b6bf878+7:2353:x1871452228832896:12345-192.168.202.41@tcp:2:lfs.0 Request processed in 376us (1242us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1784756142.684174:0:9140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 17 00010000:00010000:3.0:1784756142.688805:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89136c2ff200/0xc0f560bd53f931f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756142.688824:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89136c2ff200/0xc0f560bd53f931f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756142.688849:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89136c2ff200/0xc0f560bd53f931f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756142.688856:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89136c2ff200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784756142.688861:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89136c2ff200/0xc0f560bd53f931f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756142.688869:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89136c2ff200/0xc0f560bd53f931f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756142.688886:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff891343cfd000) 00010000:00010000:3.0:1784756142.688889:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784756142.688894:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89136c2ff200/0xc0f560bd53f931f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756142.688901:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89136c2ff200/0xc0f560bd53f931f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756142.725185:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1784756142.725326:0:7464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228833024 00000100:00100000:2.0:1784756142.725338:0:7464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228833024 00000100:00100000:2.0:1784756142.725404:0:7464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 2 00000100:00100000:2.0:1784756142.725434:0:7464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136fa49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:391dd9f2-6bf0-4674-aedd-25845b6bf878+7:5562:x1871452228833024:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784756142.725453:0:7464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784756142.725492:0:7464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ecd658c/0xc0f560bd53f930a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575acce expref: 7 pid: 9140 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756142.725518:0:7464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784756142.725582:0:7464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136fa49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:5562:x1871452228833024:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 169us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756142.725591:0:7464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 2 00000100:00100000:2.0:1784756142.785733:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1784756142.785835:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228833280 00000100:00100000:0.0:1784756142.785845:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228833280 00000100:00100000:0.0:1784756142.785905:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 37 00000100:00100000:0.0:1784756142.785914:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:391dd9f2-6bf0-4674-aedd-25845b6bf878+11:11166:x1871452228833280:12345-192.168.202.41@tcp:101:dd.0 00010000:00010000:0.0:1784756142.785941:0:5775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756142.785961:0:5775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89136c9e7c00/0xc0f560bd53f9326 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9935e598575acd5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.786030:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89136c9e7200/0xc0f560bd53f932d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.786045:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89136c9e7200/0xc0f560bd53f932d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.786057:0:5775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89136c9e7200/0xc0f560bd53f932d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.786084:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89136c9e6600/0xc0f560bd53f9334 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6a35613e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.786092:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89136c9e6600/0xc0f560bd53f9334 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.786099:0:5775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89136c9e6600/0xc0f560bd53f9334 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.786504:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89136c9e6400/0xc0f560bd53f933b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.786514:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89136c9e6400/0xc0f560bd53f933b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.786535:0:5775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89136c9e6400/0xc0f560bd53f933b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784756142.786547:0:5775:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 2097152 00010000:00010000:0.0:1784756142.786662:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89136c9e7200/0xc0f560bd53f932d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.786669:0:5775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89136c9e7200/0xc0f560bd53f932d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.786676:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89136c9e7200/0xc0f560bd53f932d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.786682:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89136c9e7200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784756142.786686:0:5775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89136c9e7200/0xc0f560bd53f932d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.786693:0:5775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89136c9e7200/0xc0f560bd53f932d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.786705:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff891351091600) 00010000:00010000:0.0:1784756142.786708:0:5775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784756142.786713:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89136c9e7200/0xc0f560bd53f932d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.786719:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89136c9e7200/0xc0f560bd53f932d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.786732:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89136c9e6600/0xc0f560bd53f9334 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.786739:0:5775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89136c9e6600/0xc0f560bd53f9334 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.786751:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89136c9e6600/0xc0f560bd53f9334 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.786755:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89136c9e6600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784756142.786758:0:5775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89136c9e6600/0xc0f560bd53f9334 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.786775:0:5775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89136c9e6600/0xc0f560bd53f9334 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.786783:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6a35613e (ffff89134803d400) 00010000:00010000:0.0:1784756142.786786:0:5775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784756142.786789:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89136c9e6600/0xc0f560bd53f9334 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.786796:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89136c9e6600/0xc0f560bd53f9334 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.786840:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89136c9e7c00/0xc0f560bd53f9326 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575acd5 expref: 14 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.786853:0:5775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89136c9e6400/0xc0f560bd53f933b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575acd5 expref: 13 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.786861:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff891343cfd000) 00010000:00010000:0.0:1784756142.786863:0:5775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784756142.786865:0:5775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89136c9e6400, rc 0) 00000100:00100000:0.0:1784756142.786982:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:391dd9f2-6bf0-4674-aedd-25845b6bf878+13:11166:x1871452228833280:12345-192.168.202.41@tcp:101:dd.0 Request processed in 1068us (1259us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1784756142.787000:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 37 00000100:00100000:0.0:1784756142.793077:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1784756142.793159:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228833536 00000100:00100000:1.0:1784756142.793168:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228833536 00000100:00100000:1.0:1784756142.793228:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:1.0:1784756142.793238:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136fa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+13:11166:x1871452228833536:12345-192.168.202.41@tcp:35:dd.0 00000100:00100000:1.0:1784756142.793844:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136fa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+14:11166:x1871452228833536:12345-192.168.202.41@tcp:35:dd.0 Request processed in 605us (785us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1784756142.793853:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:0.0:1784756142.798481:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1784756142.798678:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228833664 00000100:00100000:3.0:1784756142.798687:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228833664 00000100:00100000:3.0:1784756142.798748:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 18 00000100:00100000:3.0:1784756142.798758:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f4da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:391dd9f2-6bf0-4674-aedd-25845b6bf878+6:2351:x1871452228833664:12345-192.168.202.41@tcp:101:dd.0 00010000:00010000:3.0:1784756142.798788:0:6578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784756142.798811:0:6578:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015a9160d/0xc0f560bd53f9349 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf9935e598575acdc expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784756142.798840:0:6578:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 2097152, mtime: 0x6a6137ae, atime: 0x0, ctime: 0x6a6137ae, blocks: 0x1007 00010000:00010000:3.0:1784756142.798861:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=260s v=(0 0) 00010000:00010000:3.0:1784756142.798865:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784756142.798883:0:6578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015a9160d/0xc0f560bd53f9349 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575acdc expref: 7 pid: 6578 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756142.798903:0:6578:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000015a9160d/0xc0f560bd53f9349 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xf9935e598575acdc expref: 7 pid: 6578 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756142.798918:0:6578:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89134151a600, rc 0) 00000100:00100000:3.0:1784756142.799170:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f4da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:391dd9f2-6bf0-4674-aedd-25845b6bf878+7:2351:x1871452228833664:12345-192.168.202.41@tcp:101:dd.0 Request processed in 413us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756142.799179:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 18 00000100:00100000:2.0:1784756142.841494:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1784756142.841525:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1784756142.841626:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228833792 00000100:00100000:0.0:1784756142.841638:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228833792 00000100:00100000:0.0:1784756142.841706:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452228833920 00000100:00100000:0.0:1784756142.841710:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452228833920 00000100:00100000:0.0:1784756142.841742:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 4 00000100:00100000:0.0:1784756142.841753:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f46aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+8:2354:x1871452228833792:12345-192.168.202.41@tcp:3:dd.0 00010000:00010000:0.0:1784756142.841825:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006abe53c9/0xc0f560bd53f9350 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.841846:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784756142.841851:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784756142.841858:0:6581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006abe53c9/0xc0f560bd53f9350 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.841875:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006abe53c9/0xc0f560bd53f9350 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756142.842217:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 5 00000100:00100000:3.0:1784756142.842228:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f468380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:391dd9f2-6bf0-4674-aedd-25845b6bf878+9:2354:x1871452228833920:12345-192.168.202.41@tcp:3:dd.0 00010000:00010000:3.0:1784756142.842246:0:6582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000edfe06f0/0xc0f560bd53f9357 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756142.842256:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784756142.842259:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784756142.842264:0:6582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edfe06f0/0xc0f560bd53f9357 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756142.842274:0:6582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edfe06f0/0xc0f560bd53f9357 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.864517:0:6582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000edfe06f0/0xc0f560bd53f9357 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.864538:0:6582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000edfe06f0/0xc0f560bd53f9357 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.864548:0:6582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000edfe06f0/0xc0f560bd53f9357 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.864582:0:6582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89134151ac00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:0.0:1784756142.864588:0:6582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000edfe06f0/0xc0f560bd53f9357 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.864598:0:6582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000edfe06f0/0xc0f560bd53f9357 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.864833:0:6582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000edfe06f0/0xc0f560bd53f9357 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.864843:0:6582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edfe06f0/0xc0f560bd53f9357 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756142.864992:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f468380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:391dd9f2-6bf0-4674-aedd-25845b6bf878+9:2354:x1871452228833920:12345-192.168.202.41@tcp:3:dd.0 Request processed in 22759us (23459us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1784756142.865004:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 5 00010000:00010000:0.0:1784756142.881874:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006abe53c9/0xc0f560bd53f9350 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.881894:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006abe53c9/0xc0f560bd53f9350 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.881905:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006abe53c9/0xc0f560bd53f9350 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.881913:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89136c9e6600 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:0.0:1784756142.881934:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006abe53c9/0xc0f560bd53f9350 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.881945:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006abe53c9/0xc0f560bd53f9350 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.881965:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006abe53c9/0xc0f560bd53f9350 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756142.881974:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006abe53c9/0xc0f560bd53f9350 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756142.885168:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f46aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:391dd9f2-6bf0-4674-aedd-25845b6bf878+7:2354:x1871452228833792:12345-192.168.202.41@tcp:3:dd.0 Request processed in 40312us (40579us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1784756142.885182:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 4 00010000:00010000:0.0:1784756143.476047:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784756143.497690:0:5796:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967313 is committed 00000001:00080000:1.0:1784756143.497713:0:5796:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967314 is committed 00000001:00080000:3.0:1784756143.507599:0:7478:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:0.0:1784756144.438329:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89136f46b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237256960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784756144.438507:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756144.438738:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452237256960 00000100:00100000:2.0:1784756144.438769:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452237256960 00000100:00100000:2.0:1784756144.438834:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784756144.438844:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89136f4d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237256960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784756144.438883:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1784756144.438931:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89136f4d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1871452237256960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756144.438939:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784756144.438985:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89136f46b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1871452237256960:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1784756144.439061:0:5770:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784756144.500915:0:7465:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784756144.691974:0:11739:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity test_119l: @@@@@@ FAIL: (5) nohybrid should prevent switch, stats: 1 00010000:00010000:1.0:1784756145.524297:0:5762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756146.551640:0:5763:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 9618 lines, 9618 kept, 0 dropped, 0 bad.